Sep 21 11:44:38 devstack cinder-volume[75209]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 21 11:44:38 devstack cinder-volume[75209]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 21 11:44:38 devstack cinder-volume[75209]: we strongly recommend against using it for new projects. Sep 21 11:44:38 devstack cinder-volume[75209]: If you are already using Eventlet, we recommend migrating to a different Sep 21 11:44:38 devstack cinder-volume[75209]: framework. For more detail see Sep 21 11:44:38 devstack cinder-volume[75209]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 21 11:44:38 devstack cinder-volume[75209]: import eventlet # noqa Sep 21 11:44:41 devstack cinder-volume[75209]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75209) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 21 11:44:41 devstack cinder-volume[75209]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75209) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 21 11:44:41 devstack cinder-volume[75209]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75209) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 21 11:44:42 devstack cinder-volume[75209]: INFO dbcounter [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Registered counter for database cinder Sep 21 11:44:42 devstack cinder-volume[75209]: DEBUG oslo_db.sqlalchemy.engines [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75209) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 21 11:44:42 devstack cinder-volume[75209]: DEBUG dbcounter [-] [75209] Writer thread running {{(pid=75209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 21 11:44:43 devstack cinder-volume[75209]: INFO cinder.rpc [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 21 11:44:43 devstack cinder-volume[75209]: INFO cinder.rpc [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 21 11:44:43 devstack cinder-volume[75209]: DEBUG oslo_db.sqlalchemy.engines [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75209) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 21 11:44:43 devstack cinder-volume[75209]: INFO cinder.volume.manager [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Determined volume DB was empty at startup. Sep 21 11:44:43 devstack cinder-volume[75209]: DEBUG cinder.volume.manager [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75209) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 21 11:44:43 devstack cinder-volume[75209]: INFO cinder.volume.manager [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 21 11:44:43 devstack cinder-volume[75209]: WARNING stevedore.named [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 21 11:44:43 devstack cinder-volume[75209]: WARNING castellan.key_manager [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 21 11:44:43 devstack cinder-volume[75209]: WARNING cinder.keymgr.conf_key_mgr [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 21 11:44:43 devstack cinder-volume[75209]: DEBUG cinder.volume.drivers.lvm [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75209) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 21 11:44:43 devstack cinder-volume[75209]: DEBUG oslo_concurrency.processutils [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:43 devstack cinder-volume[75209]: DEBUG oslo_concurrency.processutils [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] CMD "cinder-rtstool verify" returned: 0 in 0.485s {{(pid=75209) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:43 devstack cinder-volume[75209]: DEBUG oslo_db.sqlalchemy.engines [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75209) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 21 11:44:43 devstack cinder-volume[75209]: INFO cinder.rpc [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 21 11:44:43 devstack cinder-volume[75209]: INFO cinder.rpc [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 21 11:44:43 devstack cinder-volume[75209]: WARNING stevedore.named [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 21 11:44:43 devstack cinder-volume[75209]: WARNING castellan.key_manager [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 21 11:44:43 devstack cinder-volume[75209]: INFO cinder.volume.manager [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 21 11:44:43 devstack cinder-volume[75209]: DEBUG oslo_db.sqlalchemy.engines [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75209) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 21 11:44:43 devstack cinder-volume[75209]: INFO oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Starting 1 workers Sep 21 11:44:43 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Started child 75366 {{(pid=75209) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 21 11:44:43 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Full set of CONF: {{(pid=75209) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 21 11:44:43 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] ******************************************************************************** {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 21 11:44:43 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Configuration options gathered from: {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 21 11:44:43 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 21 11:44:43 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 21 11:44:43 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] ================================================================================ {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 21 11:44:43 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] allow_availability_zone_fallback = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:43 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] allow_compression_on_image_upload = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:43 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] allowed_direct_url_schemes = [] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:43 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] api_rate_limit = True {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:43 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] auth_strategy = keystone {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:43 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] az_cache_duration = 3600 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:43 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_availability_zone = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:43 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_host = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:43 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_name = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:43 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_stats_polling_interval = 60 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backup_api_class = cinder.backup.api.API {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backup_name_template = backup-%s {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backup_use_same_host = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backup_use_temp_snapshot = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75366]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] chap_password = **** {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] chap_username = {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cinder_internal_tenant_project_id = fe4f26616e03427ba9bb511d56f79ebf {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cinder_internal_tenant_user_id = a4eadd2cd7974811a06bf4f5d076fec2 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cloned_volume_same_az = True {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cluster = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] compression_format = gzip {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] compute_api_class = cinder.compute.nova.API {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] config_dir = [] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] config_source = [] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] control_exchange = openstack {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] debug = True {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] default_availability_zone = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] default_group_type = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] default_volume_type = lvmdriver-1 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] disk_geometry = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] driver_client_cert = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] driver_client_cert_key = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] driver_data_namespace = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] driver_ssl_cert_path = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] driver_ssl_cert_verify = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] driver_use_ssl = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] enable_force_upload = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] enable_new_services = True {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] enable_unsupported_driver = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] enforce_multipath_for_image_xfer = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] filter_function = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] glance_api_insecure = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] glance_api_servers = ['http://192.168.122.27/image'] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] glance_api_ssl_compression = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] glance_ca_certificates_file = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] glance_catalog_info = image:glance:publicURL {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] glance_certfile = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] glance_keyfile = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] glance_num_retries = 3 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] glance_request_timeout = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] goodness_function = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] graceful_shutdown_timeout = 5 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] group_api_class = cinder.group.api.API {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] host = devstack {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] image_compress_on_upload = True {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] image_conversion_address_space_limit = 1 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] image_conversion_cpu_limit = 60 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] image_conversion_disable = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] image_introspection_address_space_limit = 1 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] image_introspection_cpu_limit = 60 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] image_upload_use_cinder_backend = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] image_upload_use_internal_tenant = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] image_volume_cache_enabled = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] image_volume_cache_max_count = 0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] image_volume_cache_max_size_gb = 0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] init_host_max_objects_retrieval = 0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] instance_format = [instance: %(uuid)s] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] iscsi_target_flags = {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] iscsi_write_cache = on {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] iser_helper = tgtadm {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] iser_ip_address = 192.168.122.27 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] iser_port = 3260 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] log_color = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] log_config_append = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] log_dir = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] log_file = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] log_options = True {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] log_rotate_interval = 1 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] log_rotate_interval_type = days {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] log_rotation_type = none {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] max_age = 0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] max_logfile_count = 30 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] max_logfile_size_mb = 200 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] max_over_subscription_ratio = 20.0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] message_reap_interval = 86400 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] message_ttl = 2592000 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] migration_create_volume_timeout_secs = 300 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] monkey_patch = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] monkey_patch_modules = [] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] my_ip = 192.168.122.27 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] no_snapshot_gb_quota = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] num_iser_scan_tries = 3 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] num_shell_tries = 3 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] num_volume_device_scan_tries = 3 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] nvmeof_conn_info_version = 1 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] nvmet_ns_id = 10 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] nvmet_port_id = 1 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] osapi_max_limit = 1000 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] osapi_volume_ext_list = [] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] osapi_volume_listen_port = 8776 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] osapi_volume_use_ssl = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] osapi_volume_workers = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] per_volume_size_limit = -1 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] periodic_fuzzy_delay = 60 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] periodic_interval = 60 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] public_endpoint = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] publish_errors = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] quota_backup_gigabytes = 1000 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75366]: INFO cinder.volume.manager [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] quota_backups = 10 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] quota_gigabytes = 1000 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] quota_groups = 10 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] quota_snapshots = 10 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] quota_volumes = 10 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] rate_limit_burst = 0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] rate_limit_except_level = CRITICAL {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] rate_limit_interval = 0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] reinit_driver_count = 3 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] replication_device = **** {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] report_discard_supported = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] report_interval = 120 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] reservation_clean_interval = 86400 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] reservation_expire = 86400 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] reserved_image_namespaces = [] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] reserved_percentage = 0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] rpc_response_timeout = 120 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] run_external_periodic_tasks = True {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] scst_target_driver = iscsi {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] scst_target_iqn_name = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] service_down_time = 720 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] shell_completion = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] snapshot_name_template = snapshot-%s {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] snapshot_same_host = True {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] split_loggers = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] state_path = /opt/stack/data/cinder {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] storage_availability_zone = nova {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] storage_protocol = iSCSI {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] syslog_log_facility = LOG_USER {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] target_helper = lioadm {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] target_ip_address = 192.168.122.27 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] target_port = 3260 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] target_protocol = iscsi {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] target_secondary_ip_addresses = [] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] trace_flags = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] transport_url = **** {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] until_refresh = 0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] use_chap_auth = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] use_default_quota_class = True {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] use_journal = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] use_json = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] use_multipath_for_image_xfer = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] use_stderr = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] use_syslog = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] verify_glance_signatures = enabled {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] volume_api_class = cinder.volume.api.API {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] volume_backend_name = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] volume_clear = zero {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] volume_clear_ionice = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] volume_clear_size = 0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] volume_copy_bps_limit = 0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] volume_dd_blocksize = 1M {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] volume_name_template = volume-%s {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] volume_service_inithost_offload = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] volume_usage_audit_period = month {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] zoning_mode = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_concurrency.disable_process_locking = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.auth_section = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.auth_type = password {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.auth_version = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.cache = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.certfile = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.include_service_catalog = True {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.insecure = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.interface = public {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.keyfile = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.memcache_password = **** {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.memcache_username = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.region_name = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.service_type = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.27/identity {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.backend = dogpile.cache.null {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.backend_argument = **** {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.backend_expiration_time = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.config_prefix = cache.oslo {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.debug_cache_backend = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.enable_retry_client = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.enable_socket_keepalive = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.enabled = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.expiration_time = 600 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.hashclient_retry_attempts = 2 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.memcache_dead_retry = 300 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.memcache_pool_maxsize = 10 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.memcache_sasl_enabled = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.password = **** {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.proxies = [] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.redis_db = 0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.redis_server = localhost:6379 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.retry_attempts = 2 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.retry_delay = 0.0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.socket_keepalive_count = 1 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.socket_keepalive_idle = 1 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.socket_keepalive_interval = 1 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.socket_timeout = 1.0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.tls_allowed_ciphers = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.tls_cafile = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.tls_certfile = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.tls_enabled = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.tls_keyfile = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cache.username = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] coordination.backend_url = **** {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] database.asyncio_connection = **** {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] database.asyncio_slave_connection = **** {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] database.backend = sqlalchemy {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] database.connection = **** {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] database.connection_debug = 0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] database.connection_parameters = {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] database.connection_recycle_time = 3600 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] database.connection_trace = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] database.db_inc_retry_interval = True {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] database.db_max_retries = 20 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] database.db_max_retry_interval = 10 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] database.db_retry_interval = 1 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] database.max_overflow = 50 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] database.max_pool_size = 5 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] database.max_retries = 10 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] database.mysql_wsrep_sync_wait = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] database.pool_timeout = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] database.retry_interval = 10 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] database.slave_connection = **** {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] database.sqlite_synchronous = True {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] database.synchronous_reader = True {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] database.use_db_reconnect = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_tracing.insecure = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] profiler.connection_string = messaging:// {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] profiler.enabled = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] profiler.es_doc_type = notification {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] profiler.es_scroll_size = 10000 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] profiler.es_scroll_time = 2m {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] profiler.filter_error_trace = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] profiler.hmac_keys = **** {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] profiler.sentinel_service_name = mymaster {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] profiler.socket_timeout = 0.1 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] profiler.trace_requests = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] profiler.trace_sqlalchemy = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] profiler_jaeger.process_tags = {} {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] profiler_jaeger.service_name_prefix = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] profiler_otlp.service_name_prefix = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_policy.enforce_new_defaults = True {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_policy.policy_default_rule = default {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_policy.policy_file = policy.yaml {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] privsep_osbrick.group = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] privsep_osbrick.helper_command = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] privsep_osbrick.user = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cinder_sys_admin.group = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cinder_sys_admin.helper_command = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] cinder_sys_admin.user = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] service_user.auth_section = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] service_user.auth_type = password {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] service_user.cafile = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] service_user.certfile = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] service_user.collect_timing = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] service_user.insecure = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] service_user.keyfile = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] service_user.send_service_user_token = True {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] service_user.split_loggers = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] service_user.timeout = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] service_user.tls_ciphers = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] service_user.tls_min_version = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] glance.auth_section = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] glance.auth_type = password {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] glance.certfile = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] glance.collect_timing = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] glance.insecure = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] glance.keyfile = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] glance.region_name = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] glance.split_loggers = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] glance.timeout = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] glance.tls_ciphers = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] glance.tls_min_version = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.backend_availability_zone = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.chap_password = **** {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.chap_username = {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.disk_geometry = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.driver_client_cert = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.driver_client_cert_key = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.driver_data_namespace = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:44 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.driver_use_ssl = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.extra_capabilities = {} {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.filter_function = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.goodness_function = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.iscsi_target_flags = {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.iscsi_write_cache = on {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.iser_helper = tgtadm {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.iser_ip_address = 192.168.122.27 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.iser_port = 3260 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.lvm_share_target = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.lvm_type = auto {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.num_shell_tries = 3 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.replication_device = **** {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.report_discard_supported = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.reserved_percentage = 0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.target_helper = tgtadm {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack sudo[75373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 21 11:44:44 devstack sudo[75373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.target_ip_address = 192.168.122.27 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.target_port = 3260 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.target_protocol = iscsi {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.trace_flags = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.unique_fqdn_network = True {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.use_chap_auth = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.volume_backend_name = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.volume_clear = zero {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.volume_clear_ionice = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.volume_clear_size = 0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_reports.file_event_handler = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_reports.log_dir = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.backend_host = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.chap_password = **** {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.chap_username = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.disk_geometry = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.driver_client_cert = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.extra_capabilities = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.filter_function = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.goodness_function = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.iser_helper = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.iser_ip_address = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.iser_port = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.lvm_share_target = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.lvm_type = auto {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.num_shell_tries = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.replication_device = **** {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.report_discard_supported = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.reserved_percentage = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.scst_target_driver = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.storage_protocol = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.target_helper = lioadm {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.target_ip_address = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.target_port = 3260 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.trace_flags = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.use_chap_auth = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.volume_clear = zero {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.volume_clear_size = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] lvmdriver-1.volumes_dir = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.ssl = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_notifications.driver = [] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_notifications.retry = -1 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] key_manager.fixed_key = **** {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican.barbican_api_version = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican.barbican_endpoint = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican.barbican_endpoint_type = public {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican.barbican_region_name = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican.cafile = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican.certfile = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican.collect_timing = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican.insecure = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican.keyfile = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican.number_of_retries = 60 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican.retry_delay = 1 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican.send_service_user_token = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican.split_loggers = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican.timeout = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican.tls_ciphers = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican.tls_min_version = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican.verify_ssl = True {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican.verify_ssl_path = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican_service_user.auth_section = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican_service_user.auth_type = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican_service_user.cafile = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican_service_user.certfile = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican_service_user.collect_timing = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican_service_user.insecure = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican_service_user.keyfile = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican_service_user.split_loggers = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican_service_user.timeout = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican_service_user.tls_ciphers = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] barbican_service_user.tls_min_version = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] vault.approle_role_id = **** {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] vault.approle_secret_id = **** {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] vault.auth_method = approle {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] vault.auth_path = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] vault.kv_mountpoint = secret {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] vault.kv_path = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] vault.kv_version = 2 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] vault.namespace = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] vault.root_token_id = **** {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] vault.ssl_ca_crt_file = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] vault.timeout = 60.0 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] vault.token_file = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] vault.token_role = None {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] vault.use_ssl = False {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:44:44 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] ******************************************************************************** {{(pid=75209) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 21 11:44:44 devstack sudo[75373]: pam_unix(sudo:session): session closed for user root Sep 21 11:44:44 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:44 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:44 devstack sudo[75376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 21 11:44:44 devstack sudo[75376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:44:44 devstack sudo[75376]: pam_unix(sudo:session): session closed for user root Sep 21 11:44:44 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.257s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:44 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 11:44:44 devstack cinder-volume[75366]: INFO cinder.brick.local_dev.lvm [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 21 11:44:44 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:44 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:44 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:44 devstack sudo[75382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 21 11:44:44 devstack sudo[75382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:44:44 devstack sudo[75382]: pam_unix(sudo:session): session closed for user root Sep 21 11:44:44 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:44 devstack cinder-volume[75366]: DEBUG cinder.brick.local_dev.lvm [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75366) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 21 11:44:44 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:45 devstack sudo[75453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 21 11:44:45 devstack sudo[75453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:44:45 devstack sudo[75453]: pam_unix(sudo:session): session closed for user root Sep 21 11:44:45 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.513s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:45 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:45 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:45 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:45 devstack sudo[75669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 21 11:44:45 devstack sudo[75669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:44:45 devstack sudo[75669]: pam_unix(sudo:session): session closed for user root Sep 21 11:44:45 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:45 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:45 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:45 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:45 devstack sudo[75760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 21 11:44:45 devstack sudo[75760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:44:46 devstack sudo[75760]: pam_unix(sudo:session): session closed for user root Sep 21 11:44:46 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.265s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:46 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:46 devstack sudo[75839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 21 11:44:46 devstack sudo[75839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:44:46 devstack sudo[75839]: pam_unix(sudo:session): session closed for user root Sep 21 11:44:46 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:46 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:46 devstack sudo[75957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 21 11:44:46 devstack sudo[75957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:44:46 devstack sudo[75957]: pam_unix(sudo:session): session closed for user root Sep 21 11:44:46 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:46 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:46 devstack sudo[75986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 21 11:44:46 devstack sudo[75986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:44:46 devstack sudo[75986]: pam_unix(sudo:session): session closed for user root Sep 21 11:44:46 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:46 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:46 devstack sudo[76029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 21 11:44:46 devstack sudo[76029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:44:47 devstack sudo[76029]: pam_unix(sudo:session): session closed for user root Sep 21 11:44:47 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.337s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:47 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:47 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:47 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:47 devstack sudo[76073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 21 11:44:47 devstack sudo[76073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:44:47 devstack sudo[76073]: pam_unix(sudo:session): session closed for user root Sep 21 11:44:47 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:47 devstack cinder-volume[75366]: INFO cinder.volume.drivers.lvm [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 21 11:44:47 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:47 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:47 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:47 devstack sudo[76083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 21 11:44:47 devstack sudo[76083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:44:47 devstack sudo[76083]: pam_unix(sudo:session): session closed for user root Sep 21 11:44:47 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.359s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:47 devstack cinder-volume[75366]: DEBUG cinder.volume.drivers.lvm [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Updating volume stats {{(pid=75366) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 21 11:44:47 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:47 devstack sudo[76167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 21 11:44:47 devstack sudo[76167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:44:48 devstack sudo[76167]: pam_unix(sudo:session): session closed for user root Sep 21 11:44:48 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:48 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:48 devstack sudo[76170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 21 11:44:48 devstack sudo[76170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:44:48 devstack sudo[76170]: pam_unix(sudo:session): session closed for user root Sep 21 11:44:48 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:48 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:48 devstack sudo[76179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 21 11:44:48 devstack sudo[76179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:44:48 devstack sudo[76179]: pam_unix(sudo:session): session closed for user root Sep 21 11:44:48 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:48 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:48 devstack sudo[76182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 21 11:44:48 devstack sudo[76182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:44:48 devstack sudo[76182]: pam_unix(sudo:session): session closed for user root Sep 21 11:44:49 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:49 devstack cinder-volume[75366]: INFO cinder.volume.driver [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Driver hasn't implemented _init_vendor_properties() Sep 21 11:44:49 devstack cinder-volume[75366]: DEBUG cinder.volume.driver [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75366) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 21 11:44:49 devstack cinder-volume[75366]: DEBUG oslo_db.sqlalchemy.engines [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75366) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 21 11:44:49 devstack cinder-volume[75366]: DEBUG dbcounter [-] [75366] Writer thread running {{(pid=75366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 21 11:44:49 devstack cinder-volume[75366]: DEBUG cinder.db.api [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Building query based on filter {{(pid=75366) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 21 11:44:49 devstack cinder-volume[75366]: DEBUG cinder.image.image_utils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75366) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 21 11:44:49 devstack cinder-volume[75366]: INFO cinder.keymgr.migration [None req-7d0c7e6b-3acb-4705-b7d5-b2a259dfe15a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 21 11:44:49 devstack cinder-volume[75366]: DEBUG cinder.volume.drivers.lvm [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Updating volume stats {{(pid=75366) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 21 11:44:49 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:49 devstack sudo[76187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 21 11:44:49 devstack sudo[76187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:44:49 devstack sudo[76187]: pam_unix(sudo:session): session closed for user root Sep 21 11:44:49 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:49 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:49 devstack sudo[76190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 21 11:44:49 devstack sudo[76190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:44:49 devstack sudo[76190]: pam_unix(sudo:session): session closed for user root Sep 21 11:44:49 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:49 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:49 devstack sudo[76193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 21 11:44:49 devstack sudo[76193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:44:49 devstack sudo[76193]: pam_unix(sudo:session): session closed for user root Sep 21 11:44:49 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:49 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:49 devstack sudo[76197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 21 11:44:49 devstack sudo[76197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:44:50 devstack sudo[76197]: pam_unix(sudo:session): session closed for user root Sep 21 11:44:50 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:50 devstack cinder-volume[75366]: DEBUG cinder.manager [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Notifying Schedulers of capabilities ... {{(pid=75366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:44:50 devstack cinder-volume[75366]: INFO cinder.volume.manager [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Driver initialization completed successfully. Sep 21 11:44:50 devstack cinder-volume[75366]: INFO cinder.manager [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Initiating service 2 cleanup Sep 21 11:44:50 devstack cinder-volume[75366]: INFO cinder.manager [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Service 2 cleanup completed. Sep 21 11:44:50 devstack cinder-volume[75366]: DEBUG cinder.service [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Creating RPC server for service cinder-volume {{(pid=75366) start /opt/stack/cinder/cinder/service.py:231}} Sep 21 11:44:50 devstack cinder-volume[75366]: DEBUG cinder.service [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75366) start /opt/stack/cinder/cinder/service.py:237}} Sep 21 11:44:50 devstack cinder-volume[75366]: INFO cinder.volume.manager [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 21 11:44:50 devstack cinder-volume[75366]: DEBUG cinder.volume.drivers.lvm [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Updating volume stats {{(pid=75366) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 21 11:44:50 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:50 devstack sudo[76201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 21 11:44:50 devstack sudo[76201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:44:50 devstack sudo[76201]: pam_unix(sudo:session): session closed for user root Sep 21 11:44:50 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:50 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:50 devstack sudo[76204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 21 11:44:50 devstack sudo[76204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:44:50 devstack sudo[76204]: pam_unix(sudo:session): session closed for user root Sep 21 11:44:50 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:50 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:50 devstack sudo[76207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 21 11:44:50 devstack sudo[76207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:44:51 devstack sudo[76207]: pam_unix(sudo:session): session closed for user root Sep 21 11:44:51 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:51 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:44:51 devstack sudo[76210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 21 11:44:51 devstack sudo[76210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:44:51 devstack sudo[76210]: pam_unix(sudo:session): session closed for user root Sep 21 11:44:51 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:44:51 devstack cinder-volume[75366]: INFO cinder.volume.manager [None req-5754b375-eba1-4703-bbe3-7f2454e97458 None None] Driver post RPC initialization completed successfully. Sep 21 11:44:53 devstack cinder-volume[75209]: DEBUG dbcounter [-] [75209] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75209) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:45:00 devstack cinder-volume[75366]: DEBUG dbcounter [-] [75366] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:45:01 devstack cinder-volume[75366]: DEBUG dbcounter [-] [75366] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:45:44 devstack cinder-volume[75366]: DEBUG oslo_service.periodic_task [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 11:45:44 devstack cinder-volume[75366]: DEBUG cinder.volume.drivers.lvm [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] Updating volume stats {{(pid=75366) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 21 11:45:44 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:45:44 devstack sudo[78152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 21 11:45:44 devstack sudo[78152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:45:44 devstack sudo[78152]: pam_unix(sudo:session): session closed for user root Sep 21 11:45:44 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:45:44 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:45:44 devstack sudo[78155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 21 11:45:44 devstack sudo[78155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:45:45 devstack sudo[78155]: pam_unix(sudo:session): session closed for user root Sep 21 11:45:45 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:45:45 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:45:45 devstack sudo[78158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 21 11:45:45 devstack sudo[78158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:45:45 devstack sudo[78158]: pam_unix(sudo:session): session closed for user root Sep 21 11:45:45 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:45:45 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:45:45 devstack sudo[78161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 21 11:45:45 devstack sudo[78161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:45:45 devstack sudo[78161]: pam_unix(sudo:session): session closed for user root Sep 21 11:45:45 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:45:45 devstack cinder-volume[75366]: DEBUG cinder.manager [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] Notifying Schedulers of capabilities ... {{(pid=75366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:45:45 devstack cinder-volume[75366]: DEBUG oslo_service.periodic_task [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] Running periodic task VolumeManager._thread_info {{(pid=75366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 11:45:45 devstack cinder-volume[75366]: DEBUG cinder.volume.manager [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] thread count: 6 {{(pid=75366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 11:45:45 devstack cinder-volume[75366]: DEBUG cinder.volume.manager [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] thread info: [<_MainThread(MainThread, started 125404933619840)>, , , , , ] {{(pid=75366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 11:46:44 devstack cinder-volume[75366]: DEBUG oslo_service.periodic_task [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 11:46:44 devstack cinder-volume[75366]: DEBUG cinder.volume.drivers.lvm [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] Updating volume stats {{(pid=75366) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 21 11:46:44 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:46:44 devstack sudo[81459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 21 11:46:44 devstack sudo[81459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:46:44 devstack sudo[81459]: pam_unix(sudo:session): session closed for user root Sep 21 11:46:44 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:46:44 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:46:44 devstack sudo[81462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 21 11:46:44 devstack sudo[81462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:46:45 devstack sudo[81462]: pam_unix(sudo:session): session closed for user root Sep 21 11:46:45 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:46:45 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:46:45 devstack sudo[81465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 21 11:46:45 devstack sudo[81465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:46:45 devstack sudo[81465]: pam_unix(sudo:session): session closed for user root Sep 21 11:46:45 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:46:45 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:46:45 devstack sudo[81468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 21 11:46:45 devstack sudo[81468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:46:45 devstack sudo[81468]: pam_unix(sudo:session): session closed for user root Sep 21 11:46:45 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:46:45 devstack cinder-volume[75366]: DEBUG cinder.manager [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] Notifying Schedulers of capabilities ... {{(pid=75366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:46:45 devstack cinder-volume[75366]: DEBUG oslo_service.periodic_task [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] Running periodic task VolumeManager._thread_info {{(pid=75366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 11:46:45 devstack cinder-volume[75366]: DEBUG cinder.volume.manager [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] thread count: 6 {{(pid=75366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 11:46:45 devstack cinder-volume[75366]: DEBUG cinder.volume.manager [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] thread info: [<_MainThread(MainThread, started 125404933619840)>, , , , , ] {{(pid=75366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 11:47:01 devstack cinder-volume[75366]: DEBUG dbcounter [-] [75366] Writing DB stats cinder:SELECT=1 {{(pid=75366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:47:01 devstack cinder-volume[75366]: DEBUG dbcounter [-] [75366] Writing DB stats cinder:UPDATE=1 {{(pid=75366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:47:44 devstack cinder-volume[75366]: DEBUG oslo_service.periodic_task [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 11:47:44 devstack cinder-volume[75366]: DEBUG cinder.volume.drivers.lvm [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] Updating volume stats {{(pid=75366) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 21 11:47:44 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:47:44 devstack sudo[83188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 21 11:47:44 devstack sudo[83188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:47:44 devstack sudo[83188]: pam_unix(sudo:session): session closed for user root Sep 21 11:47:44 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.347s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:47:44 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:47:44 devstack sudo[83195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 21 11:47:44 devstack sudo[83195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:47:45 devstack sudo[83195]: pam_unix(sudo:session): session closed for user root Sep 21 11:47:45 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:47:45 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:47:45 devstack sudo[83203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 21 11:47:45 devstack sudo[83203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:47:45 devstack sudo[83203]: pam_unix(sudo:session): session closed for user root Sep 21 11:47:45 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:47:45 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:47:45 devstack sudo[83220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 21 11:47:45 devstack sudo[83220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:47:45 devstack sudo[83220]: pam_unix(sudo:session): session closed for user root Sep 21 11:47:45 devstack cinder-volume[75366]: DEBUG oslo_concurrency.processutils [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:47:45 devstack cinder-volume[75366]: DEBUG cinder.manager [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] Notifying Schedulers of capabilities ... {{(pid=75366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:47:45 devstack cinder-volume[75366]: DEBUG oslo_service.periodic_task [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] Running periodic task VolumeManager._thread_info {{(pid=75366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 11:47:45 devstack cinder-volume[75366]: DEBUG cinder.volume.manager [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] thread count: 6 {{(pid=75366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 11:47:45 devstack cinder-volume[75366]: DEBUG cinder.volume.manager [None req-7f3577d9-1815-43a0-a6b5-5c2b73ca4e3e None None] thread info: [<_MainThread(MainThread, started 125404933619840)>, , , , , ] {{(pid=75366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 11:49:01 devstack cinder-volume[75366]: DEBUG dbcounter [-] [75366] Writing DB stats cinder:SELECT=1 {{(pid=75366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:49:01 devstack cinder-volume[75366]: DEBUG dbcounter [-] [75366] Writing DB stats cinder:UPDATE=1 {{(pid=75366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:49:22 devstack cinder-volume[75209]: INFO oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Caught SIGTERM, stopping children Sep 21 11:49:22 devstack cinder-volume[75209]: DEBUG oslo_concurrency.lockutils [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Acquiring lock "singleton_lock" {{(pid=75209) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 21 11:49:22 devstack cinder-volume[75209]: DEBUG oslo_concurrency.lockutils [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Acquired lock "singleton_lock" {{(pid=75209) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 21 11:49:22 devstack cinder-volume[75209]: DEBUG oslo_concurrency.lockutils [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Releasing lock "singleton_lock" {{(pid=75209) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 21 11:49:22 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Stop services. {{(pid=75209) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 21 11:49:22 devstack cinder-volume[75209]: DEBUG oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Killing children. {{(pid=75209) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 21 11:49:22 devstack cinder-volume[75209]: INFO oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Waiting on 1 children to exit Sep 21 11:49:25 devstack cinder-volume[75366]: DEBUG oslo_concurrency.lockutils [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Acquiring lock "singleton_lock" {{(pid=75366) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 21 11:49:25 devstack cinder-volume[75366]: DEBUG oslo_concurrency.lockutils [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Acquired lock "singleton_lock" {{(pid=75366) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 21 11:49:25 devstack cinder-volume[75366]: DEBUG oslo_concurrency.lockutils [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Releasing lock "singleton_lock" {{(pid=75366) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 21 11:49:25 devstack cinder-volume[75366]: WARNING amqp [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 21 11:49:25 devstack cinder-volume[75366]: WARNING amqp [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 21 11:49:25 devstack cinder-volume[75209]: INFO oslo_service.backend._eventlet.service [None req-76b1b701-b369-4b05-87a6-2008e37a5003 None None] Child 75366 exited with status 0 Sep 21 11:49:25 devstack cinder-volume[85355]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 21 11:49:25 devstack cinder-volume[85355]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 21 11:49:25 devstack cinder-volume[85355]: we strongly recommend against using it for new projects. Sep 21 11:49:25 devstack cinder-volume[85355]: If you are already using Eventlet, we recommend migrating to a different Sep 21 11:49:25 devstack cinder-volume[85355]: framework. For more detail see Sep 21 11:49:25 devstack cinder-volume[85355]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 21 11:49:25 devstack cinder-volume[85355]: import eventlet # noqa Sep 21 11:49:27 devstack cinder-volume[85355]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85355) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 21 11:49:27 devstack cinder-volume[85355]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85355) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 21 11:49:27 devstack cinder-volume[85355]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85355) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 21 11:49:28 devstack cinder-volume[85355]: INFO dbcounter [None req-876d308c-bae2-4f71-b238-615816c8489f None None] Registered counter for database cinder Sep 21 11:49:28 devstack cinder-volume[85355]: DEBUG oslo_db.sqlalchemy.engines [None req-876d308c-bae2-4f71-b238-615816c8489f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85355) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 21 11:49:28 devstack cinder-volume[85355]: DEBUG dbcounter [-] [85355] Writer thread running {{(pid=85355) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 21 11:49:28 devstack cinder-volume[85355]: INFO cinder.rpc [None req-876d308c-bae2-4f71-b238-615816c8489f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 21 11:49:28 devstack cinder-volume[85355]: INFO cinder.rpc [None req-876d308c-bae2-4f71-b238-615816c8489f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 21 11:49:28 devstack cinder-volume[85355]: DEBUG oslo_db.sqlalchemy.engines [None req-876d308c-bae2-4f71-b238-615816c8489f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85355) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 21 11:49:29 devstack cinder-volume[85355]: INFO cinder.volume.manager [None req-876d308c-bae2-4f71-b238-615816c8489f None None] Determined volume DB was empty at startup. Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG cinder.volume.manager [None req-876d308c-bae2-4f71-b238-615816c8489f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85355) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 21 11:49:29 devstack cinder-volume[85355]: INFO cinder.volume.manager [None req-876d308c-bae2-4f71-b238-615816c8489f None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 21 11:49:29 devstack cinder-volume[85355]: WARNING stevedore.named [None req-876d308c-bae2-4f71-b238-615816c8489f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 21 11:49:29 devstack cinder-volume[85355]: WARNING castellan.key_manager [None req-876d308c-bae2-4f71-b238-615816c8489f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 21 11:49:29 devstack cinder-volume[85355]: WARNING cinder.keymgr.conf_key_mgr [None req-876d308c-bae2-4f71-b238-615816c8489f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 21 11:49:29 devstack cinder-volume[85355]: INFO cinder.volume.manager [None req-876d308c-bae2-4f71-b238-615816c8489f None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_db.sqlalchemy.engines [None req-876d308c-bae2-4f71-b238-615816c8489f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85355) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 21 11:49:29 devstack cinder-volume[85355]: INFO oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] Starting 1 workers Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] Started child 85577 {{(pid=85355) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] Full set of CONF: {{(pid=85355) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] ******************************************************************************** {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] Configuration options gathered from: {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] ================================================================================ {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] allow_availability_zone_fallback = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] allow_compression_on_image_upload = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] allowed_direct_url_schemes = [] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] api_rate_limit = True {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] auth_strategy = keystone {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_availability_zone = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_host = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_name = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_stats_polling_interval = 60 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backup_api_class = cinder.backup.api.API {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backup_name_template = backup-%s {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backup_use_same_host = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backup_use_temp_snapshot = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] chap_password = **** {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] chap_username = {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cinder_internal_tenant_project_id = fe4f26616e03427ba9bb511d56f79ebf {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cinder_internal_tenant_user_id = a4eadd2cd7974811a06bf4f5d076fec2 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cluster = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] compression_format = gzip {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] compute_api_class = cinder.compute.nova.API {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] config_dir = [] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] config_source = [] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] control_exchange = openstack {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] debug = True {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] default_availability_zone = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] default_group_type = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] default_volume_type = QuobyteHD {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] disk_geometry = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] driver_client_cert = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] driver_client_cert_key = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] driver_data_namespace = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] driver_ssl_cert_path = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] driver_ssl_cert_verify = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] driver_use_ssl = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] enable_new_services = True {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] enable_unsupported_driver = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] enabled_backends = ['QuobyteHD'] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] enforce_multipath_for_image_xfer = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] filter_function = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] glance_api_insecure = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] glance_api_servers = ['http://192.168.122.27/image'] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] glance_api_ssl_compression = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] glance_ca_certificates_file = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] glance_catalog_info = image:glance:publicURL {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] glance_certfile = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] glance_keyfile = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] glance_num_retries = 3 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] glance_request_timeout = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] goodness_function = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] graceful_shutdown_timeout = 5 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] group_api_class = cinder.group.api.API {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] host = devstack {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] image_compress_on_upload = True {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] image_conversion_address_space_limit = 1 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] image_conversion_cpu_limit = 60 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] image_conversion_disable = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] image_introspection_address_space_limit = 1 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] image_introspection_cpu_limit = 60 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] image_upload_use_cinder_backend = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] image_upload_use_internal_tenant = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] image_volume_cache_enabled = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] image_volume_cache_max_count = 0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] image_volume_cache_max_size_gb = 0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85577]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] init_host_max_objects_retrieval = 0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] instance_format = [instance: %(uuid)s] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] iscsi_target_flags = {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] iscsi_write_cache = on {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] iser_helper = tgtadm {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] iser_ip_address = 192.168.122.27 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] iser_port = 3260 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] log_color = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] log_config_append = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] log_dir = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] log_file = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] log_options = True {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] log_rotate_interval = 1 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] log_rotate_interval_type = days {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] log_rotation_type = none {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] max_age = 0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] max_logfile_count = 30 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] max_logfile_size_mb = 200 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] max_over_subscription_ratio = 20.0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] message_reap_interval = 86400 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] message_ttl = 2592000 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] migration_create_volume_timeout_secs = 300 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] monkey_patch = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] monkey_patch_modules = [] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] my_ip = 192.168.122.27 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] no_snapshot_gb_quota = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] num_iser_scan_tries = 3 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] num_shell_tries = 3 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] num_volume_device_scan_tries = 3 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] nvmeof_conn_info_version = 1 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] nvmet_ns_id = 10 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] nvmet_port_id = 1 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] osapi_max_limit = 1000 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] osapi_volume_ext_list = [] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] osapi_volume_listen = 0.0.0.0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] osapi_volume_listen_port = 8776 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] osapi_volume_use_ssl = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] osapi_volume_workers = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] per_volume_size_limit = -1 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] periodic_fuzzy_delay = 60 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] periodic_interval = 60 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] project_id_regex = [0-9a-f\-]+ {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] public_endpoint = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] publish_errors = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] quota_backup_gigabytes = 1000 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] quota_backups = 10 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] quota_gigabytes = 1000 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] quota_groups = 10 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] quota_snapshots = 10 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] quota_volumes = 10 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] rate_limit_burst = 0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] rate_limit_except_level = CRITICAL {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] rate_limit_interval = 0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] reinit_driver_count = 3 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] replication_device = **** {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] report_discard_supported = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] report_interval = 120 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] reservation_clean_interval = 86400 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] reservation_expire = 86400 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] reserved_image_namespaces = [] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] reserved_percentage = 0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] rpc_response_timeout = 120 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] run_external_periodic_tasks = True {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] scst_target_driver = iscsi {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] scst_target_iqn_name = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] service_down_time = 720 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] shell_completion = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] snapshot_name_template = snapshot-%s {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] split_loggers = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] state_path = /opt/stack/data/cinder {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] storage_availability_zone = nova {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] storage_protocol = iSCSI {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] syslog_log_facility = LOG_USER {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] target_helper = lioadm {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] target_ip_address = 192.168.122.27 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] target_port = 3260 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] target_protocol = iscsi {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] target_secondary_ip_addresses = [] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] trace_flags = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] transfer_api_class = cinder.transfer.api.API {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] transport_url = **** {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] until_refresh = 0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] use_chap_auth = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] use_default_quota_class = True {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] use_journal = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] use_json = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] use_multipath_for_image_xfer = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] use_stderr = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] use_syslog = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] verify_glance_signatures = enabled {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] volume_api_class = cinder.volume.api.API {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] volume_backend_name = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] volume_clear = zero {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] volume_clear_ionice = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] volume_clear_size = 0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] volume_copy_bps_limit = 0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] volume_dd_blocksize = 1M {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] volume_name_template = volume-%s {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] volume_service_inithost_offload = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] volume_usage_audit_period = month {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] zoning_mode = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_concurrency.disable_process_locking = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.auth_section = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.auth_type = password {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.auth_version = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.cache = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.certfile = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.delay_auth_decision = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.http_connect_timeout = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.include_service_catalog = True {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.insecure = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.interface = public {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.keyfile = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.memcache_password = **** {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.memcache_username = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.region_name = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.service_token_roles_required = True {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.service_type = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.token_cache_time = 300 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.27/identity {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.backend = dogpile.cache.null {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.backend_argument = **** {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.backend_expiration_time = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.config_prefix = cache.oslo {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.debug_cache_backend = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.enable_retry_client = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.enable_socket_keepalive = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.enabled = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.expiration_time = 600 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.hashclient_retry_attempts = 2 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.memcache_dead_retry = 300 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.memcache_pool_maxsize = 10 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.memcache_sasl_enabled = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.password = **** {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.proxies = [] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.redis_db = 0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.redis_sentinel_service_name = mymaster {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.redis_server = localhost:6379 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.retry_attempts = 2 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.retry_delay = 0.0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.socket_keepalive_count = 1 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.socket_keepalive_idle = 1 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.socket_keepalive_interval = 1 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.socket_timeout = 1.0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.tls_allowed_ciphers = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.tls_cafile = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.tls_certfile = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.tls_enabled = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.tls_keyfile = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cache.username = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] coordination.backend_url = **** {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] database.asyncio_connection = **** {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] database.asyncio_slave_connection = **** {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] database.backend = sqlalchemy {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] database.connection = **** {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] database.connection_debug = 0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] database.connection_parameters = {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] database.connection_recycle_time = 3600 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] database.connection_trace = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] database.db_inc_retry_interval = True {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] database.db_max_retries = 20 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] database.db_max_retry_interval = 10 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] database.db_retry_interval = 1 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] database.max_overflow = 50 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] database.max_pool_size = 5 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] database.max_retries = 10 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] database.mysql_wsrep_sync_wait = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] database.pool_timeout = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] database.retry_interval = 10 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] database.slave_connection = **** {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] database.sqlite_synchronous = True {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] database.synchronous_reader = True {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] database.use_db_reconnect = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_tracing.insecure = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85577]: INFO cinder.volume.manager [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Starting volume driver QuobyteDriver (1.2.1) Sep 21 11:49:29 devstack cinder-volume[85577]: DEBUG cinder.volume.drivers.remotefs [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85577) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] profiler.connection_string = messaging:// {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] profiler.enabled = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] profiler.es_doc_type = notification {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] profiler.es_scroll_size = 10000 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] profiler.es_scroll_time = 2m {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] profiler.filter_error_trace = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] profiler.hmac_keys = **** {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] profiler.sentinel_service_name = mymaster {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] profiler.socket_timeout = 0.1 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] profiler.trace_requests = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] profiler.trace_sqlalchemy = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] profiler_jaeger.process_tags = {} {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] profiler_jaeger.service_name_prefix = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] profiler_otlp.service_name_prefix = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_policy.enforce_new_defaults = True {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_policy.policy_default_rule = default {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_policy.policy_file = policy.yaml {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_policy.remote_timeout = 60.0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] privsep_osbrick.group = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] privsep_osbrick.helper_command = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] privsep_osbrick.user = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cinder_sys_admin.group = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cinder_sys_admin.helper_command = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] cinder_sys_admin.user = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] service_user.auth_section = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] service_user.auth_type = password {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] service_user.cafile = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] service_user.certfile = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] service_user.collect_timing = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] service_user.insecure = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] service_user.keyfile = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] service_user.send_service_user_token = True {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] service_user.split_loggers = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] service_user.timeout = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] service_user.tls_ciphers = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] service_user.tls_min_version = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] glance.auth_section = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] glance.auth_type = password {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] glance.certfile = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] glance.collect_timing = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] glance.insecure = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] glance.keyfile = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] glance.region_name = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] glance.split_loggers = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] glance.timeout = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] glance.tls_ciphers = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] glance.tls_min_version = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.backend_availability_zone = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.chap_password = **** {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.chap_username = {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.disk_geometry = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.driver_client_cert = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.driver_client_cert_key = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.driver_data_namespace = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.driver_use_ssl = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.enable_unsupported_driver = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.extra_capabilities = {} {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.filter_function = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.goodness_function = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.iscsi_target_flags = {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.iscsi_write_cache = on {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.iser_helper = tgtadm {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.iser_ip_address = 192.168.122.27 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.iser_port = 3260 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.nas_host = {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.nas_login = admin {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.nas_mount_options = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.nas_password = **** {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.nas_private_key = {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.nas_share_path = {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.nas_ssh_port = 22 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.num_shell_tries = 3 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.nvmet_port_id = 1 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.quobyte_client_cfg = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.quobyte_volume_url = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.replication_device = **** {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.report_discard_supported = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.reserved_percentage = 0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.scst_target_driver = iscsi {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.scst_target_iqn_name = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.storage_protocol = iSCSI {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.target_helper = tgtadm {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.target_ip_address = 192.168.122.27 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.target_port = 3260 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.target_protocol = iscsi {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.trace_flags = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.unique_fqdn_network = True {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.use_chap_auth = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.volume_backend_name = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.volume_clear = zero {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.volume_clear_ionice = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.volume_clear_size = 0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_reports.file_event_handler = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_reports.log_dir = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.backend_availability_zone = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.backend_host = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.chap_password = **** {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.chap_username = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.chiscsi_conf = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.disk_geometry = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.driver_client_cert = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.driver_client_cert_key = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.driver_data_namespace = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.driver_use_ssl = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.extra_capabilities = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.filter_function = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.goodness_function = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85577]: DEBUG cinder.volume.drivers.quobyte [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85577) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 21 11:49:29 devstack cinder-volume[85577]: WARNING cinder.volume.drivers.quobyte [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 21 11:49:29 devstack cinder-volume[85577]: WARNING cinder.volume.drivers.quobyte [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.iscsi_target_flags = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.iscsi_write_cache = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.iser_helper = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.iser_ip_address = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.iser_port = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.iser_target_prefix = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85577]: DEBUG oslo_concurrency.processutils [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Running cmd (subprocess): mount.quobyte {{(pid=85577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.nas_host = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.nas_login = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.nas_mount_options = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.nas_password = **** {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.nas_private_key = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.nas_share_path = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.nas_ssh_port = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.num_shell_tries = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.nvmet_ns_id = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.nvmet_port_id = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.replication_device = **** {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.report_discard_supported = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.reserved_percentage = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.scst_target_driver = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.storage_protocol = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.target_helper = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.target_ip_address = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.target_port = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.target_prefix = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.target_protocol = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.trace_flags = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.unique_fqdn_network = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.use_chap_auth = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.volume_clear = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.volume_clear_ionice = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.volume_clear_size = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] QuobyteHD.volumes_dir = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.ssl = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.ssl_version = {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_notifications.driver = [] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_notifications.retry = -1 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] oslo_messaging_notifications.transport_url = **** {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] key_manager.fixed_key = **** {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican.barbican_api_version = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican.barbican_endpoint = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican.barbican_endpoint_type = public {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican.barbican_region_name = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican.cafile = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican.certfile = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican.collect_timing = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican.insecure = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican.keyfile = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican.number_of_retries = 60 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican.retry_delay = 1 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican.send_service_user_token = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican.split_loggers = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican.timeout = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican.tls_ciphers = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican.tls_min_version = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican.verify_ssl = True {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican.verify_ssl_path = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican_service_user.auth_section = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican_service_user.auth_type = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican_service_user.cafile = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican_service_user.certfile = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican_service_user.collect_timing = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican_service_user.insecure = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican_service_user.keyfile = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican_service_user.split_loggers = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican_service_user.timeout = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican_service_user.tls_ciphers = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] barbican_service_user.tls_min_version = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] vault.approle_role_id = **** {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] vault.approle_secret_id = **** {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] vault.auth_method = approle {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] vault.auth_path = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] vault.kv_mountpoint = secret {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] vault.kv_path = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] vault.kv_version = 2 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] vault.namespace = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] vault.root_token_id = **** {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] vault.ssl_ca_crt_file = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] vault.timeout = 60.0 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] vault.token_file = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] vault.token_role = None {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] vault.use_ssl = False {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:29 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] ******************************************************************************** {{(pid=85355) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 21 11:49:29 devstack quobyte-client[85578]: Reading configuration file: /etc/quobyte/client.cfg Sep 21 11:49:29 devstack quobyte-client[85578]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 21 11:49:29 devstack cinder-volume[85577]: DEBUG oslo_concurrency.processutils [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] CMD "mount.quobyte" returned: 1 in 0.158s {{(pid=85577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:49:29 devstack cinder-volume[85577]: DEBUG oslo_concurrency.lockutils [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85577) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:49:29 devstack cinder-volume[85577]: DEBUG oslo_concurrency.lockutils [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85577) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:49:29 devstack cinder-volume[85577]: DEBUG cinder.volume.drivers.quobyte [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=85577) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:49:29 devstack cinder-volume[85577]: INFO cinder.volume.drivers.quobyte [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d ... Sep 21 11:49:29 devstack cinder-volume[85577]: DEBUG oslo_concurrency.processutils [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 -c /etc/quobyte/client-cinder.cfg {{(pid=85577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:49:29 devstack sudo[85581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 -c /etc/quobyte/client-cinder.cfg Sep 21 11:49:29 devstack sudo[85581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:49:30 devstack sudo[85581]: pam_unix(sudo:session): session closed for user root Sep 21 11:49:30 devstack cinder-volume[85577]: DEBUG oslo_concurrency.processutils [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.427s {{(pid=85577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:49:30 devstack cinder-volume[85577]: INFO cinder.volume.drivers.quobyte [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d succeeded Sep 21 11:49:30 devstack cinder-volume[85577]: DEBUG cinder.volume.drivers.quobyte [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=85577) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:49:30 devstack cinder-volume[85577]: DEBUG oslo_concurrency.lockutils [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.439s {{(pid=85577) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:49:30 devstack cinder-volume[85577]: DEBUG oslo_concurrency.processutils [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=85577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:49:30 devstack sudo[85682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:49:30 devstack sudo[85682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:49:30 devstack sudo[85682]: pam_unix(sudo:session): session closed for user root Sep 21 11:49:30 devstack cinder-volume[85577]: DEBUG oslo_concurrency.processutils [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.286s {{(pid=85577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:49:30 devstack cinder-volume[85577]: INFO cinder.volume.driver [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Driver hasn't implemented _init_vendor_properties() Sep 21 11:49:30 devstack cinder-volume[85577]: DEBUG cinder.volume.driver [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6625862121582, 'free_capacity_gb': 1775.6625862121582, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85577) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 21 11:49:30 devstack cinder-volume[85577]: DEBUG oslo_db.sqlalchemy.engines [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85577) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 21 11:49:30 devstack cinder-volume[85577]: DEBUG dbcounter [-] [85577] Writer thread running {{(pid=85577) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 21 11:49:30 devstack cinder-volume[85577]: DEBUG cinder.db.api [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Building query based on filter {{(pid=85577) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 21 11:49:30 devstack cinder-volume[85577]: DEBUG cinder.image.image_utils [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85577) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 21 11:49:30 devstack cinder-volume[85577]: INFO cinder.keymgr.migration [None req-d91b7e67-ee88-4311-9a5d-0d10cb8703d6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 21 11:49:30 devstack cinder-volume[85577]: DEBUG oslo_concurrency.lockutils [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85577) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:49:30 devstack cinder-volume[85577]: DEBUG oslo_concurrency.lockutils [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85577) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:49:30 devstack cinder-volume[85577]: DEBUG cinder.volume.drivers.quobyte [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=85577) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:49:30 devstack cinder-volume[85577]: DEBUG cinder.volume.drivers.quobyte [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=85577) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:49:30 devstack cinder-volume[85577]: DEBUG oslo_concurrency.lockutils [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85577) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:49:30 devstack cinder-volume[85577]: DEBUG oslo_concurrency.processutils [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=85577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:49:30 devstack sudo[85688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:49:30 devstack sudo[85688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:49:30 devstack sudo[85688]: pam_unix(sudo:session): session closed for user root Sep 21 11:49:30 devstack cinder-volume[85577]: DEBUG oslo_concurrency.processutils [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.374s {{(pid=85577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:49:30 devstack cinder-volume[85577]: DEBUG cinder.manager [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Notifying Schedulers of capabilities ... {{(pid=85577) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:49:31 devstack cinder-volume[85577]: INFO cinder.volume.manager [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Driver initialization completed successfully. Sep 21 11:49:31 devstack cinder-volume[85577]: INFO cinder.manager [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Initiating service 3 cleanup Sep 21 11:49:31 devstack cinder-volume[85577]: INFO cinder.manager [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Service 3 cleanup completed. Sep 21 11:49:31 devstack cinder-volume[85577]: DEBUG cinder.service [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Creating RPC server for service cinder-volume {{(pid=85577) start /opt/stack/cinder/cinder/service.py:231}} Sep 21 11:49:31 devstack cinder-volume[85577]: DEBUG cinder.service [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85577) start /opt/stack/cinder/cinder/service.py:237}} Sep 21 11:49:31 devstack cinder-volume[85577]: INFO cinder.volume.manager [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 21 11:49:31 devstack cinder-volume[85577]: DEBUG oslo_concurrency.lockutils [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85577) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:49:31 devstack cinder-volume[85577]: DEBUG oslo_concurrency.lockutils [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85577) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:49:31 devstack cinder-volume[85577]: DEBUG cinder.volume.drivers.quobyte [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=85577) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:49:31 devstack cinder-volume[85577]: DEBUG cinder.volume.drivers.quobyte [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=85577) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:49:31 devstack cinder-volume[85577]: DEBUG oslo_concurrency.lockutils [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85577) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:49:31 devstack cinder-volume[85577]: DEBUG oslo_concurrency.processutils [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=85577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:49:31 devstack sudo[85701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:49:31 devstack sudo[85701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:49:31 devstack sudo[85701]: pam_unix(sudo:session): session closed for user root Sep 21 11:49:31 devstack cinder-volume[85577]: DEBUG oslo_concurrency.processutils [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.365s {{(pid=85577) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:49:31 devstack cinder-volume[85577]: INFO cinder.volume.manager [None req-5d4cef3b-7e13-46e0-a914-bd1c6bf00dfa None None] Driver post RPC initialization completed successfully. Sep 21 11:49:35 devstack cinder-volume[85355]: INFO oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] Caught SIGTERM, stopping children Sep 21 11:49:35 devstack cinder-volume[85355]: DEBUG oslo_concurrency.lockutils [None req-876d308c-bae2-4f71-b238-615816c8489f None None] Acquiring lock "singleton_lock" {{(pid=85355) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 21 11:49:35 devstack cinder-volume[85355]: DEBUG oslo_concurrency.lockutils [None req-876d308c-bae2-4f71-b238-615816c8489f None None] Acquired lock "singleton_lock" {{(pid=85355) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 21 11:49:35 devstack cinder-volume[85355]: DEBUG oslo_concurrency.lockutils [None req-876d308c-bae2-4f71-b238-615816c8489f None None] Releasing lock "singleton_lock" {{(pid=85355) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 21 11:49:35 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] Stop services. {{(pid=85355) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 21 11:49:35 devstack cinder-volume[85355]: DEBUG oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] Killing children. {{(pid=85355) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 21 11:49:35 devstack cinder-volume[85355]: INFO oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] Waiting on 1 children to exit Sep 21 11:49:39 devstack cinder-volume[85577]: DEBUG oslo_concurrency.lockutils [None req-876d308c-bae2-4f71-b238-615816c8489f None None] Acquiring lock "singleton_lock" {{(pid=85577) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 21 11:49:39 devstack cinder-volume[85577]: DEBUG oslo_concurrency.lockutils [None req-876d308c-bae2-4f71-b238-615816c8489f None None] Acquired lock "singleton_lock" {{(pid=85577) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 21 11:49:39 devstack cinder-volume[85577]: DEBUG oslo_concurrency.lockutils [None req-876d308c-bae2-4f71-b238-615816c8489f None None] Releasing lock "singleton_lock" {{(pid=85577) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 21 11:49:39 devstack cinder-volume[85577]: WARNING amqp [None req-876d308c-bae2-4f71-b238-615816c8489f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 21 11:49:39 devstack cinder-volume[85577]: WARNING amqp [None req-876d308c-bae2-4f71-b238-615816c8489f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 21 11:49:39 devstack cinder-volume[85355]: INFO oslo_service.backend._eventlet.service [None req-876d308c-bae2-4f71-b238-615816c8489f None None] Child 85577 exited with status 0 Sep 21 11:49:40 devstack cinder-volume[86046]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 21 11:49:40 devstack cinder-volume[86046]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 21 11:49:40 devstack cinder-volume[86046]: we strongly recommend against using it for new projects. Sep 21 11:49:40 devstack cinder-volume[86046]: If you are already using Eventlet, we recommend migrating to a different Sep 21 11:49:40 devstack cinder-volume[86046]: framework. For more detail see Sep 21 11:49:40 devstack cinder-volume[86046]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 21 11:49:40 devstack cinder-volume[86046]: import eventlet # noqa Sep 21 11:49:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86046) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 21 11:49:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86046) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 21 11:49:42 devstack cinder-volume[86046]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86046) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 21 11:49:43 devstack cinder-volume[86046]: INFO dbcounter [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] Registered counter for database cinder Sep 21 11:49:43 devstack cinder-volume[86046]: DEBUG oslo_db.sqlalchemy.engines [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86046) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writer thread running {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 21 11:49:44 devstack cinder-volume[86046]: INFO cinder.rpc [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 21 11:49:44 devstack cinder-volume[86046]: INFO cinder.rpc [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_db.sqlalchemy.engines [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86046) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 21 11:49:44 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] Determined volume DB was empty at startup. Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG cinder.volume.manager [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86046) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 21 11:49:44 devstack cinder-volume[86046]: WARNING stevedore.named [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 21 11:49:44 devstack cinder-volume[86046]: WARNING castellan.key_manager [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 21 11:49:44 devstack cinder-volume[86046]: WARNING cinder.keymgr.conf_key_mgr [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 21 11:49:44 devstack cinder-volume[86046]: INFO cinder.volume.manager [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_db.sqlalchemy.engines [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86046) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 21 11:49:44 devstack cinder-volume[86046]: INFO oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] Starting 1 workers Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] Started child 86366 {{(pid=86046) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] Full set of CONF: {{(pid=86046) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] ******************************************************************************** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] Configuration options gathered from: {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] ================================================================================ {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] allow_availability_zone_fallback = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] allow_compression_on_image_upload = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] allowed_direct_url_schemes = [] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] api_rate_limit = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] auth_strategy = keystone {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_availability_zone = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_host = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_name = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_stats_polling_interval = 60 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backup_api_class = cinder.backup.api.API {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backup_name_template = backup-%s {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backup_use_same_host = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backup_use_temp_snapshot = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] chap_password = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] chap_username = {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86366]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cinder_internal_tenant_project_id = fe4f26616e03427ba9bb511d56f79ebf {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cinder_internal_tenant_user_id = a4eadd2cd7974811a06bf4f5d076fec2 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cluster = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] compression_format = gzip {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] compute_api_class = cinder.compute.nova.API {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] config_dir = [] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] config_source = [] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] control_exchange = openstack {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] debug = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] default_availability_zone = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] default_group_type = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] default_volume_type = QuobyteHD {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] disk_geometry = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] driver_client_cert = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] driver_client_cert_key = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] driver_data_namespace = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] driver_ssl_cert_path = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] driver_ssl_cert_verify = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] driver_use_ssl = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] enable_new_services = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] enable_unsupported_driver = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] enabled_backends = ['QuobyteHD'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] enforce_multipath_for_image_xfer = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] filter_function = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] glance_api_insecure = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] glance_api_servers = ['http://192.168.122.27/image'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] glance_api_ssl_compression = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] glance_ca_certificates_file = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] glance_catalog_info = image:glance:publicURL {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] glance_certfile = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] glance_keyfile = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] glance_num_retries = 3 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] glance_request_timeout = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] goodness_function = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] graceful_shutdown_timeout = 5 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] group_api_class = cinder.group.api.API {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] host = devstack {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] image_compress_on_upload = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] image_conversion_address_space_limit = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] image_conversion_cpu_limit = 60 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] image_conversion_disable = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] image_introspection_address_space_limit = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] image_introspection_cpu_limit = 60 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] image_upload_use_cinder_backend = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] image_upload_use_internal_tenant = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] image_volume_cache_enabled = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] image_volume_cache_max_count = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] image_volume_cache_max_size_gb = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] init_host_max_objects_retrieval = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] instance_format = [instance: %(uuid)s] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] iscsi_target_flags = {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] iscsi_write_cache = on {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] iser_helper = tgtadm {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] iser_ip_address = 192.168.122.27 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] iser_port = 3260 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] log_color = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] log_config_append = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] log_dir = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] log_file = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] log_options = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] log_rotate_interval = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] log_rotate_interval_type = days {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] log_rotation_type = none {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] max_age = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] max_logfile_count = 30 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] max_logfile_size_mb = 200 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] max_over_subscription_ratio = 20.0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] message_reap_interval = 86400 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] message_ttl = 2592000 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] migration_create_volume_timeout_secs = 300 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] monkey_patch = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] monkey_patch_modules = [] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] my_ip = 192.168.122.27 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] no_snapshot_gb_quota = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] num_iser_scan_tries = 3 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] num_shell_tries = 3 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] num_volume_device_scan_tries = 3 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] nvmeof_conn_info_version = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] nvmet_ns_id = 10 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] nvmet_port_id = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] osapi_max_limit = 1000 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] osapi_volume_ext_list = [] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] osapi_volume_listen = 0.0.0.0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] osapi_volume_listen_port = 8776 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] osapi_volume_use_ssl = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] osapi_volume_workers = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] per_volume_size_limit = -1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] periodic_fuzzy_delay = 60 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] periodic_interval = 60 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] project_id_regex = [0-9a-f\-]+ {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] public_endpoint = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] publish_errors = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] quota_backup_gigabytes = 1000 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] quota_backups = 10 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] quota_gigabytes = 1000 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] quota_groups = 10 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] quota_snapshots = 10 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] quota_volumes = 10 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] rate_limit_burst = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] rate_limit_except_level = CRITICAL {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] rate_limit_interval = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] reinit_driver_count = 3 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] replication_device = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] report_discard_supported = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] report_interval = 120 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] reservation_clean_interval = 86400 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] reservation_expire = 86400 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] reserved_image_namespaces = [] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] reserved_percentage = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] rpc_response_timeout = 120 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] run_external_periodic_tasks = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] scst_target_driver = iscsi {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] scst_target_iqn_name = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] service_down_time = 720 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] shell_completion = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] snapshot_name_template = snapshot-%s {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] split_loggers = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] state_path = /opt/stack/data/cinder {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] storage_availability_zone = nova {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] storage_protocol = iSCSI {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] syslog_log_facility = LOG_USER {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] target_helper = lioadm {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] target_ip_address = 192.168.122.27 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] target_port = 3260 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] target_protocol = iscsi {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] target_secondary_ip_addresses = [] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] trace_flags = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] transfer_api_class = cinder.transfer.api.API {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] transport_url = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] until_refresh = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] use_chap_auth = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] use_default_quota_class = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] use_journal = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] use_json = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] use_multipath_for_image_xfer = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] use_stderr = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] use_syslog = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] verify_glance_signatures = enabled {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] volume_api_class = cinder.volume.api.API {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] volume_backend_name = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] volume_clear = zero {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] volume_clear_ionice = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] volume_clear_size = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] volume_copy_bps_limit = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] volume_dd_blocksize = 1M {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] volume_name_template = volume-%s {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] volume_service_inithost_offload = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] volume_usage_audit_period = month {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] zoning_mode = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_concurrency.disable_process_locking = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.auth_section = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.auth_type = password {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.auth_version = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.cache = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Starting volume driver QuobyteDriver (1.2.1) Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.certfile = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.delay_auth_decision = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.http_connect_timeout = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.include_service_catalog = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.insecure = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.interface = public {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.keyfile = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.memcache_password = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.memcache_username = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.region_name = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.service_token_roles_required = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.service_type = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.token_cache_time = 300 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.27/identity {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86366) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.backend = dogpile.cache.null {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.backend_argument = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.backend_expiration_time = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.config_prefix = cache.oslo {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.debug_cache_backend = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.enable_retry_client = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.enable_socket_keepalive = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.enabled = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.expiration_time = 600 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.hashclient_retry_attempts = 2 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.memcache_dead_retry = 300 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.memcache_pool_maxsize = 10 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.memcache_sasl_enabled = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.password = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.proxies = [] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.redis_db = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.redis_sentinel_service_name = mymaster {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.redis_server = localhost:6379 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.retry_attempts = 2 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.retry_delay = 0.0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.socket_keepalive_count = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.socket_keepalive_idle = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.socket_keepalive_interval = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.socket_timeout = 1.0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.tls_allowed_ciphers = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.tls_cafile = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.tls_certfile = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.tls_enabled = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.tls_keyfile = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cache.username = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] coordination.backend_url = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] database.asyncio_connection = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] database.asyncio_slave_connection = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] database.backend = sqlalchemy {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] database.connection = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] database.connection_debug = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] database.connection_parameters = {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] database.connection_recycle_time = 3600 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] database.connection_trace = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] database.db_inc_retry_interval = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] database.db_max_retries = 20 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] database.db_max_retry_interval = 10 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] database.db_retry_interval = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] database.max_overflow = 50 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] database.max_pool_size = 5 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] database.max_retries = 10 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] database.mysql_wsrep_sync_wait = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] database.pool_timeout = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] database.retry_interval = 10 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] database.slave_connection = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] database.sqlite_synchronous = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] database.synchronous_reader = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] database.use_db_reconnect = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_tracing.insecure = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] profiler.connection_string = messaging:// {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] profiler.enabled = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] profiler.es_doc_type = notification {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] profiler.es_scroll_size = 10000 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] profiler.es_scroll_time = 2m {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] profiler.filter_error_trace = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] profiler.hmac_keys = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] profiler.sentinel_service_name = mymaster {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] profiler.socket_timeout = 0.1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] profiler.trace_requests = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] profiler.trace_sqlalchemy = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] profiler_jaeger.process_tags = {} {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] profiler_jaeger.service_name_prefix = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] profiler_otlp.service_name_prefix = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_policy.enforce_new_defaults = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_policy.policy_default_rule = default {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_policy.policy_file = policy.yaml {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_policy.remote_timeout = 60.0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] privsep_osbrick.group = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] privsep_osbrick.helper_command = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] privsep_osbrick.user = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cinder_sys_admin.group = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cinder_sys_admin.helper_command = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] cinder_sys_admin.user = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] service_user.auth_section = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] service_user.auth_type = password {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] service_user.cafile = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] service_user.certfile = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] service_user.collect_timing = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] service_user.insecure = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] service_user.keyfile = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] service_user.send_service_user_token = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] service_user.split_loggers = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] service_user.timeout = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] service_user.tls_ciphers = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] service_user.tls_min_version = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] glance.auth_section = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] glance.auth_type = password {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] glance.certfile = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] glance.collect_timing = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] glance.insecure = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] glance.keyfile = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] glance.region_name = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] glance.split_loggers = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] glance.timeout = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] glance.tls_ciphers = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] glance.tls_min_version = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.backend_availability_zone = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.chap_password = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.chap_username = {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.disk_geometry = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.driver_client_cert = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.driver_client_cert_key = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.driver_data_namespace = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.driver_use_ssl = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.enable_unsupported_driver = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.extra_capabilities = {} {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.filter_function = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.goodness_function = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.iscsi_target_flags = {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.iscsi_write_cache = on {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.iser_helper = tgtadm {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.iser_ip_address = 192.168.122.27 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.iser_port = 3260 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.nas_host = {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.nas_login = admin {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.nas_mount_options = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.nas_password = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.nas_private_key = {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.nas_share_path = {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.nas_ssh_port = 22 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.num_shell_tries = 3 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.nvmet_port_id = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.quobyte_client_cfg = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.quobyte_volume_url = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.replication_device = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.report_discard_supported = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.reserved_percentage = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.scst_target_driver = iscsi {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.scst_target_iqn_name = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.storage_protocol = iSCSI {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.target_helper = tgtadm {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.target_ip_address = 192.168.122.27 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.target_port = 3260 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.target_protocol = iscsi {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.trace_flags = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.unique_fqdn_network = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.use_chap_auth = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.volume_backend_name = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.volume_clear = zero {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.volume_clear_ionice = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86366) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.volume_clear_size = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.quobyte [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.quobyte [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Running cmd (subprocess): mount.quobyte {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_reports.file_event_handler = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_reports.log_dir = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.backend_availability_zone = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.backend_host = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.chap_password = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.chap_username = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.chiscsi_conf = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.disk_geometry = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.driver_client_cert = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.driver_client_cert_key = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.driver_data_namespace = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.driver_use_ssl = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.extra_capabilities = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.filter_function = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.goodness_function = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.iscsi_target_flags = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.iscsi_write_cache = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.iser_helper = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.iser_ip_address = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.iser_port = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.iser_target_prefix = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.nas_host = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.nas_login = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.nas_mount_options = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.nas_password = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.nas_private_key = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.nas_share_path = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.nas_ssh_port = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.num_shell_tries = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.nvmet_ns_id = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.nvmet_port_id = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.replication_device = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.report_discard_supported = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.reserved_percentage = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.scst_target_driver = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.storage_protocol = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.target_helper = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.target_ip_address = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.target_port = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.target_prefix = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.target_protocol = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.trace_flags = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.unique_fqdn_network = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.use_chap_auth = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.volume_clear = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.volume_clear_ionice = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.volume_clear_size = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] QuobyteHD.volumes_dir = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.ssl = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.ssl_version = {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_notifications.driver = [] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_notifications.retry = -1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] oslo_messaging_notifications.transport_url = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] key_manager.fixed_key = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican.barbican_api_version = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican.barbican_endpoint = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican.barbican_endpoint_type = public {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican.barbican_region_name = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican.cafile = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican.certfile = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican.collect_timing = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican.insecure = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican.keyfile = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican.number_of_retries = 60 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican.retry_delay = 1 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican.send_service_user_token = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican.split_loggers = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican.timeout = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican.tls_ciphers = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican.tls_min_version = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican.verify_ssl = True {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican.verify_ssl_path = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican_service_user.auth_section = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican_service_user.auth_type = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican_service_user.cafile = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican_service_user.certfile = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican_service_user.collect_timing = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican_service_user.insecure = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican_service_user.keyfile = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican_service_user.split_loggers = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican_service_user.timeout = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican_service_user.tls_ciphers = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack quobyte-client[86367]: Reading configuration file: /etc/quobyte/client.cfg Sep 21 11:49:44 devstack quobyte-client[86367]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] barbican_service_user.tls_min_version = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] vault.approle_role_id = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] vault.approle_secret_id = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] vault.auth_method = approle {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] vault.auth_path = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] vault.kv_mountpoint = secret {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] vault.kv_path = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] vault.kv_version = 2 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] vault.namespace = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] vault.root_token_id = **** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] vault.ssl_ca_crt_file = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] CMD "mount.quobyte" returned: 1 in 0.053s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] vault.timeout = 60.0 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] vault.token_file = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] vault.token_role = None {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] vault.use_ssl = False {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 21 11:49:44 devstack cinder-volume[86046]: DEBUG oslo_service.backend._eventlet.service [None req-5c775d9f-5e68-48be-918e-78df5e2633fb None None] ******************************************************************************** {{(pid=86046) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 21 11:49:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:49:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:49:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:49:44 devstack sudo[86368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:49:44 devstack sudo[86368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:49:44 devstack sudo[86368]: pam_unix(sudo:session): session closed for user root Sep 21 11:49:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.238s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:49:44 devstack cinder-volume[86366]: INFO cinder.volume.driver [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Driver hasn't implemented _init_vendor_properties() Sep 21 11:49:44 devstack cinder-volume[86366]: DEBUG cinder.volume.driver [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6625900268555, 'free_capacity_gb': 1775.6625900268555, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86366) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 21 11:49:44 devstack cinder-volume[86366]: DEBUG oslo_db.sqlalchemy.engines [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86366) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 21 11:49:44 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writer thread running {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 21 11:49:44 devstack cinder-volume[86366]: DEBUG cinder.db.api [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Building query based on filter {{(pid=86366) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 21 11:49:44 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86366) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 21 11:49:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:49:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:49:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:49:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:49:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:49:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:49:44 devstack cinder-volume[86366]: INFO cinder.keymgr.migration [None req-af2ed62d-cd78-4461-947d-ca744c934479 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 21 11:49:44 devstack sudo[86379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:49:44 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:49:45 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root Sep 21 11:49:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.253s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:49:45 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:49:45 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Driver initialization completed successfully. Sep 21 11:49:45 devstack cinder-volume[86366]: INFO cinder.manager [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Initiating service 3 cleanup Sep 21 11:49:45 devstack cinder-volume[86366]: INFO cinder.manager [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Service 3 cleanup completed. Sep 21 11:49:45 devstack cinder-volume[86366]: DEBUG cinder.service [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Creating RPC server for service cinder-volume {{(pid=86366) start /opt/stack/cinder/cinder/service.py:231}} Sep 21 11:49:45 devstack cinder-volume[86366]: DEBUG cinder.service [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86366) start /opt/stack/cinder/cinder/service.py:237}} Sep 21 11:49:45 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 21 11:49:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:49:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:49:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:49:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:49:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:49:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:49:45 devstack sudo[86390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:49:45 devstack sudo[86390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:49:45 devstack sudo[86390]: pam_unix(sudo:session): session closed for user root Sep 21 11:49:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.249s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:49:45 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-eeef9f57-9010-424c-bb21-27513dbecd5b None None] Driver post RPC initialization completed successfully. Sep 21 11:49:54 devstack cinder-volume[86046]: DEBUG dbcounter [-] [86046] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86046) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:49:55 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=2 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:49:55 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:50:03 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 11:50:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread count: 6 {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 11:50:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread info: [<_MainThread(MainThread, started 132841976594560)>, , , , , ] {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 11:51:03 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 11:51:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:51:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:51:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:51:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:51:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:51:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:51:03 devstack sudo[87020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:51:03 devstack sudo[87020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:51:04 devstack sudo[87020]: pam_unix(sudo:session): session closed for user root Sep 21 11:51:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.917s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:51:04 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:51:04 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 11:51:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread count: 6 {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 11:51:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread info: [<_MainThread(MainThread, started 132841976594560)>, , , , , ] {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 11:51:06 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:51:06 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Flow 'volume_create_manager' (117f5ae0-fb17-42ce-bc7a-b31aa2fa9035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:51:06 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce941950-2c35-4cea-9ee3-cd7d44fbf5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:51:06 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce941950-2c35-4cea-9ee3-cd7d44fbf5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1864877611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d034339-4d72-42fd-bba0-fd81afe5902f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0a719fe48154bac971045670c07dc48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:51:06Z,use_quota=True,user_id='8d7fc863337544e885a6cfbb5ff324cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:51:06 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6bc564a-fdf0-47b1-9d5b-f10501b01133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:51:06 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6bc564a-fdf0-47b1-9d5b-f10501b01133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:51:06 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbc92d8-486d-4afe-a774-8995961fa078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:51:06 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbc92d8-486d-4afe-a774-8995961fa078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d034339-4d72-42fd-bba0-fd81afe5902f', 'volume_name': 'volume-6d034339-4d72-42fd-bba0-fd81afe5902f', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:51:06 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af465136-2eb6-4ed0-856d-705c07e61f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:51:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af465136-2eb6-4ed0-856d-705c07e61f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:51:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b84c7d35-5278-4c4e-8e7a-aa348bfb6eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:51:07 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Volume 6d034339-4d72-42fd-bba0-fd81afe5902f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d034339-4d72-42fd-bba0-fd81afe5902f', 'volume_size': 1} Sep 21 11:51:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:51:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:51:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1864877611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d034339-4d72-42fd-bba0-fd81afe5902f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0a719fe48154bac971045670c07dc48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:51:06Z,use_quota=True,user_id='8d7fc863337544e885a6cfbb5ff324cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:51:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Creating volume 6d034339-4d72-42fd-bba0-fd81afe5902f {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:51:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:51:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:51:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:51:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:51:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:51:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:51:07 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:51:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6d034339-4d72-42fd-bba0-fd81afe5902f 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:51:07 devstack sudo[87028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6d034339-4d72-42fd-bba0-fd81afe5902f 1073741824 Sep 21 11:51:07 devstack sudo[87028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:51:08 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:51:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Flow 'volume_create_manager' (3fb755de-83c9-4004-aa6e-f77c9843a7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:51:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee9dea7-8094-4e52-b95c-c5ecc1d78e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:51:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee9dea7-8094-4e52-b95c-c5ecc1d78e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-238288350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45a2c8e3-d011-4ebc-b7c0-efc0ae4fca42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa7d2cdd782c47ca8aa2c2b9e885f3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:51:08Z,use_quota=True,user_id='934daa56cd564c8492a7c1069e45447e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:51:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c3fa00-8ab1-479f-8271-ea4522249525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:51:08 devstack sudo[87028]: pam_unix(sudo:session): session closed for user root Sep 21 11:51:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c3fa00-8ab1-479f-8271-ea4522249525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:51:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d5c4f81-e26b-47e5-abf2-6951ad44d418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:51:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d5c4f81-e26b-47e5-abf2-6951ad44d418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45a2c8e3-d011-4ebc-b7c0-efc0ae4fca42', 'volume_name': 'volume-45a2c8e3-d011-4ebc-b7c0-efc0ae4fca42', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:51:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be9cffc-29e2-45f6-a3e4-0a623c76752b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:51:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be9cffc-29e2-45f6-a3e4-0a623c76752b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:51:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e135e0d-76c4-401e-bc83-67fda037a2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:51:08 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Volume 45a2c8e3-d011-4ebc-b7c0-efc0ae4fca42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45a2c8e3-d011-4ebc-b7c0-efc0ae4fca42', 'volume_size': 1} Sep 21 11:51:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:51:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6d034339-4d72-42fd-bba0-fd81afe5902f 1073741824" returned: 0 in 1.754s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:51:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6d034339-4d72-42fd-bba0-fd81afe5902f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:51:08 devstack sudo[87348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6d034339-4d72-42fd-bba0-fd81afe5902f Sep 21 11:51:08 devstack sudo[87348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:51:09 devstack sudo[87348]: pam_unix(sudo:session): session closed for user root Sep 21 11:51:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6d034339-4d72-42fd-bba0-fd81afe5902f" returned: 0 in 0.412s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:51:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] <== create_volume: return (2269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:51:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.276s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:51:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.514s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:51:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:51:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-238288350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45a2c8e3-d011-4ebc-b7c0-efc0ae4fca42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa7d2cdd782c47ca8aa2c2b9e885f3c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:51:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:51:08Z,use_quota=True,user_id='934daa56cd564c8492a7c1069e45447e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:51:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Creating volume 45a2c8e3-d011-4ebc-b7c0-efc0ae4fca42 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:51:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:51:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:51:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:51:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:51:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:51:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:51:09 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:51:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-45a2c8e3-d011-4ebc-b7c0-efc0ae4fca42 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:51:09 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b84c7d35-5278-4c4e-8e7a-aa348bfb6eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d034339-4d72-42fd-bba0-fd81afe5902f', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:51:09 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60dfb37f-1857-41f8-88bd-04a8f10b2d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:51:09 devstack sudo[87351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-45a2c8e3-d011-4ebc-b7c0-efc0ae4fca42 1073741824 Sep 21 11:51:09 devstack sudo[87351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:51:09 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Volume volume-6d034339-4d72-42fd-bba0-fd81afe5902f (6d034339-4d72-42fd-bba0-fd81afe5902f): created successfully Sep 21 11:51:09 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60dfb37f-1857-41f8-88bd-04a8f10b2d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:51:09 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Flow 'volume_create_manager' (117f5ae0-fb17-42ce-bc7a-b31aa2fa9035) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:51:09 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-00337f46-b47e-43af-94ca-2ddaa91284ee tempest-DeleteServersTestJSON-5778723 None] Created volume successfully. Sep 21 11:51:10 devstack sudo[87351]: pam_unix(sudo:session): session closed for user root Sep 21 11:51:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-45a2c8e3-d011-4ebc-b7c0-efc0ae4fca42 1073741824" returned: 0 in 1.099s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:51:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-45a2c8e3-d011-4ebc-b7c0-efc0ae4fca42 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:51:10 devstack sudo[87359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-45a2c8e3-d011-4ebc-b7c0-efc0ae4fca42 Sep 21 11:51:10 devstack sudo[87359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:51:11 devstack sudo[87359]: pam_unix(sudo:session): session closed for user root Sep 21 11:51:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-45a2c8e3-d011-4ebc-b7c0-efc0ae4fca42" returned: 0 in 0.540s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:51:11 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:51:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:51:11 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e135e0d-76c4-401e-bc83-67fda037a2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45a2c8e3-d011-4ebc-b7c0-efc0ae4fca42', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:51:11 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb17f2c-b6af-448b-9e16-cf5cd9b253ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:51:11 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Volume volume-45a2c8e3-d011-4ebc-b7c0-efc0ae4fca42 (45a2c8e3-d011-4ebc-b7c0-efc0ae4fca42): created successfully Sep 21 11:51:11 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb17f2c-b6af-448b-9e16-cf5cd9b253ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:51:11 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Flow 'volume_create_manager' (3fb755de-83c9-4004-aa6e-f77c9843a7ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:51:11 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1ef367ad-6dcd-4091-9e54-22dfd46b6984 tempest-VolumesAdminNegativeTest-748743730 None] Created volume successfully. Sep 21 11:51:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-96b3738a-518d-4c0c-8995-077f6c9d7002 tempest-VolumesAdminNegativeTest-748743730 None] Acquiring lock "cinder-45a2c8e3-d011-4ebc-b7c0-efc0ae4fca42-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:51:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-96b3738a-518d-4c0c-8995-077f6c9d7002 tempest-VolumesAdminNegativeTest-748743730 None] Lock "cinder-45a2c8e3-d011-4ebc-b7c0-efc0ae4fca42-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:51:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-96b3738a-518d-4c0c-8995-077f6c9d7002 tempest-VolumesAdminNegativeTest-748743730 None] Acquiring lock "cinder-quobyte-45a2c8e3-d011-4ebc-b7c0-efc0ae4fca42" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:51:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-96b3738a-518d-4c0c-8995-077f6c9d7002 tempest-VolumesAdminNegativeTest-748743730 None] Lock "cinder-quobyte-45a2c8e3-d011-4ebc-b7c0-efc0ae4fca42" acquired by "delete_volume" :: waited 0.049s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:51:13 devstack cinder-volume[86366]: INFO oslo.privsep.daemon [None req-96b3738a-518d-4c0c-8995-077f6c9d7002 tempest-VolumesAdminNegativeTest-748743730 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpug6khsok/privsep.sock'] Sep 21 11:51:13 devstack sudo[87400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpug6khsok/privsep.sock Sep 21 11:51:13 devstack sudo[87400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:51:14 devstack cinder-volume[86366]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 21 11:51:14 devstack cinder-volume[86366]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 21 11:51:14 devstack cinder-volume[86366]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 21 11:51:14 devstack cinder-volume[86366]: WARNING oslo.privsep.daemon [-] privsep log: Sep 21 11:51:14 devstack cinder-volume[86366]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 21 11:51:14 devstack cinder-volume[86366]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 21 11:51:14 devstack cinder-volume[86366]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 21 11:51:14 devstack cinder-volume[86366]: WARNING oslo.privsep.daemon [-] privsep log: Sep 21 11:51:14 devstack cinder-volume[86366]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 21 11:51:14 devstack sudo[87400]: pam_unix(sudo:session): session closed for user root Sep 21 11:51:14 devstack cinder-volume[86366]: INFO oslo.privsep.daemon [None req-96b3738a-518d-4c0c-8995-077f6c9d7002 tempest-VolumesAdminNegativeTest-748743730 None] Spawned new privsep daemon via rootwrap Sep 21 11:51:14 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [None req-96b3738a-518d-4c0c-8995-077f6c9d7002 tempest-VolumesAdminNegativeTest-748743730 None] Accepted privsep connection to /tmp/tmpug6khsok/privsep.sock {{(pid=86366) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 21 11:51:14 devstack cinder-volume[86366]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 21 11:51:14 devstack cinder-volume[86366]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 21 11:51:14 devstack cinder-volume[86366]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 21 11:51:14 devstack cinder-volume[86366]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87408 Sep 21 11:51:14 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[169c5f98-ef8b-4570-abd3-578ffb7c6df1]: (2,) {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:51:14 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad8cc37-a477-4b71-aa4f-1e2b2dc79b87]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:51:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-96b3738a-518d-4c0c-8995-077f6c9d7002 tempest-VolumesAdminNegativeTest-748743730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-45a2c8e3-d011-4ebc-b7c0-efc0ae4fca42 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:51:14 devstack sudo[87410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-45a2c8e3-d011-4ebc-b7c0-efc0ae4fca42 Sep 21 11:51:14 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:51:15 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root Sep 21 11:51:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-96b3738a-518d-4c0c-8995-077f6c9d7002 tempest-VolumesAdminNegativeTest-748743730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-45a2c8e3-d011-4ebc-b7c0-efc0ae4fca42" returned: 0 in 0.539s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:51:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-96b3738a-518d-4c0c-8995-077f6c9d7002 tempest-VolumesAdminNegativeTest-748743730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-45a2c8e3-d011-4ebc-b7c0-efc0ae4fca42 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:51:15 devstack sudo[87452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-45a2c8e3-d011-4ebc-b7c0-efc0ae4fca42 Sep 21 11:51:15 devstack sudo[87452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:51:15 devstack sudo[87452]: pam_unix(sudo:session): session closed for user root Sep 21 11:51:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-96b3738a-518d-4c0c-8995-077f6c9d7002 tempest-VolumesAdminNegativeTest-748743730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-45a2c8e3-d011-4ebc-b7c0-efc0ae4fca42" returned: 0 in 0.469s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:51:15 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-96b3738a-518d-4c0c-8995-077f6c9d7002 tempest-VolumesAdminNegativeTest-748743730 None] Lock "cinder-quobyte-45a2c8e3-d011-4ebc-b7c0-efc0ae4fca42" released by "delete_volume" :: held 2.601s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:51:15 devstack cinder-volume[86366]: WARNING cinder.quota [None req-96b3738a-518d-4c0c-8995-077f6c9d7002 tempest-VolumesAdminNegativeTest-748743730 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 21 11:51:15 devstack cinder-volume[86366]: WARNING cinder.quota [None req-96b3738a-518d-4c0c-8995-077f6c9d7002 tempest-VolumesAdminNegativeTest-748743730 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 21 11:51:15 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-96b3738a-518d-4c0c-8995-077f6c9d7002 tempest-VolumesAdminNegativeTest-748743730 None] Created reservations ['fe19566b-0034-4b37-96e6-7e27529f39ed', 'd5b936f0-1db3-480e-a16e-d8ba53472f7e', 'd905e05a-48ac-4cde-ad8d-63fbd3e56786', '585257bc-a690-4c17-8e9c-24f0cfee7438'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:51:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-96b3738a-518d-4c0c-8995-077f6c9d7002 tempest-VolumesAdminNegativeTest-748743730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:51:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-96b3738a-518d-4c0c-8995-077f6c9d7002 tempest-VolumesAdminNegativeTest-748743730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:51:15 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-96b3738a-518d-4c0c-8995-077f6c9d7002 tempest-VolumesAdminNegativeTest-748743730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:51:15 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-96b3738a-518d-4c0c-8995-077f6c9d7002 tempest-VolumesAdminNegativeTest-748743730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:51:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-96b3738a-518d-4c0c-8995-077f6c9d7002 tempest-VolumesAdminNegativeTest-748743730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:51:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-96b3738a-518d-4c0c-8995-077f6c9d7002 tempest-VolumesAdminNegativeTest-748743730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:51:15 devstack sudo[87465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:51:15 devstack sudo[87465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:51:16 devstack cinder-volume[86366]: WARNING py.warnings [req-c8fd9252-4e84-4b10-9903-b0020b999527 req-2d73e4e5-390d-47b4-9c67-a34e9017983a tempest-DeleteServersTestJSON-5778723 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 21 11:51:16 devstack cinder-volume[86366]: .first() Sep 21 11:51:16 devstack cinder-volume[86366]: Sep 21 11:51:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-c8fd9252-4e84-4b10-9903-b0020b999527 req-2d73e4e5-390d-47b4-9c67-a34e9017983a tempest-DeleteServersTestJSON-5778723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:51:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-c8fd9252-4e84-4b10-9903-b0020b999527 req-2d73e4e5-390d-47b4-9c67-a34e9017983a tempest-DeleteServersTestJSON-5778723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:51:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-c8fd9252-4e84-4b10-9903-b0020b999527 req-2d73e4e5-390d-47b4-9c67-a34e9017983a tempest-DeleteServersTestJSON-5778723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:51:16 devstack sudo[87465]: pam_unix(sudo:session): session closed for user root Sep 21 11:51:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-96b3738a-518d-4c0c-8995-077f6c9d7002 tempest-VolumesAdminNegativeTest-748743730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.459s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:51:16 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-96b3738a-518d-4c0c-8995-077f6c9d7002 tempest-VolumesAdminNegativeTest-748743730 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:51:16 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-96b3738a-518d-4c0c-8995-077f6c9d7002 tempest-VolumesAdminNegativeTest-748743730 None] Deleted volume successfully. Sep 21 11:51:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-c8fd9252-4e84-4b10-9903-b0020b999527 req-2d73e4e5-390d-47b4-9c67-a34e9017983a tempest-DeleteServersTestJSON-5778723 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d', 'name': 'volume-6d034339-4d72-42fd-bba0-fd81afe5902f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be29b926-8775-4ab3-a9a5-32c32ec7851c', 'enforce_multipath': True} {{(pid=86366) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 11:51:16 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-96b3738a-518d-4c0c-8995-077f6c9d7002 tempest-VolumesAdminNegativeTest-748743730 None] Lock "cinder-45a2c8e3-d011-4ebc-b7c0-efc0ae4fca42-delete_volume" released by "delete_volume" :: held 3.762s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:51:16 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-c8fd9252-4e84-4b10-9903-b0020b999527 req-2d73e4e5-390d-47b4-9c67-a34e9017983a tempest-DeleteServersTestJSON-5778723 None] attachment_update completed successfully. Sep 21 11:51:22 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-e1338caa-9e6d-4fee-a1f9-24ed2cdfca00 req-eae456e3-da01-4c24-bb53-58b32d6367e2 tempest-DeleteServersTestJSON-5778723 None] Terminate volume connection completed successfully. Sep 21 11:51:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-e1338caa-9e6d-4fee-a1f9-24ed2cdfca00 req-eae456e3-da01-4c24-bb53-58b32d6367e2 tempest-DeleteServersTestJSON-5778723 None] Deleting attachment be29b926-8775-4ab3-a9a5-32c32ec7851c. {{(pid=86366) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 11:51:24 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:51:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Flow 'volume_create_manager' (3e9e6408-4c6c-4b1f-87aa-657e1bb2abb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:51:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0da98656-ea0c-4d5f-87d4-b8318de73fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:51:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0da98656-ea0c-4d5f-87d4-b8318de73fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1613062033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b728d14-338c-4c9e-af12-ee2cd1cd3d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8887c4d7d0fe40a6a1dad5cbc6cd3ccc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:51:25Z,use_quota=True,user_id='71732352520440d7801c956cd2635518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:51:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96be6929-4a3b-4283-b3f7-540c620f892a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:51:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96be6929-4a3b-4283-b3f7-540c620f892a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:51:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (555bd7f5-2cdb-4c6f-8a8a-6ca4183aa14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:51:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (555bd7f5-2cdb-4c6f-8a8a-6ca4183aa14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b728d14-338c-4c9e-af12-ee2cd1cd3d91', 'volume_name': 'volume-5b728d14-338c-4c9e-af12-ee2cd1cd3d91', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:51:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a163f1-4bb7-4b22-9c7e-a472d198cf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:51:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a163f1-4bb7-4b22-9c7e-a472d198cf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:51:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb030689-9fa2-4bf3-9d0f-8c20aa622eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:51:24 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Volume 5b728d14-338c-4c9e-af12-ee2cd1cd3d91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b728d14-338c-4c9e-af12-ee2cd1cd3d91', 'volume_size': 1} Sep 21 11:51:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:51:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:51:24 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1613062033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b728d14-338c-4c9e-af12-ee2cd1cd3d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8887c4d7d0fe40a6a1dad5cbc6cd3ccc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:51:25Z,use_quota=True,user_id='71732352520440d7801c956cd2635518',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:51:24 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Creating volume 5b728d14-338c-4c9e-af12-ee2cd1cd3d91 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:51:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:51:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:51:24 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:51:25 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:51:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:51:25 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:51:25 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:51:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b728d14-338c-4c9e-af12-ee2cd1cd3d91 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:51:25 devstack sudo[87970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b728d14-338c-4c9e-af12-ee2cd1cd3d91 1073741824 Sep 21 11:51:25 devstack sudo[87970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:51:25 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0d1611ae-e9f6-47ad-959c-04b613e008cc tempest-DeleteServersTestJSON-5778723 None] Acquiring lock "cinder-6d034339-4d72-42fd-bba0-fd81afe5902f-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:51:25 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0d1611ae-e9f6-47ad-959c-04b613e008cc tempest-DeleteServersTestJSON-5778723 None] Lock "cinder-6d034339-4d72-42fd-bba0-fd81afe5902f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:51:25 devstack sudo[87970]: pam_unix(sudo:session): session closed for user root Sep 21 11:51:25 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0d1611ae-e9f6-47ad-959c-04b613e008cc tempest-DeleteServersTestJSON-5778723 None] Acquiring lock "cinder-quobyte-6d034339-4d72-42fd-bba0-fd81afe5902f" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:51:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b728d14-338c-4c9e-af12-ee2cd1cd3d91 1073741824" returned: 0 in 0.713s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:51:25 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0d1611ae-e9f6-47ad-959c-04b613e008cc tempest-DeleteServersTestJSON-5778723 None] Lock "cinder-quobyte-6d034339-4d72-42fd-bba0-fd81afe5902f" acquired by "delete_volume" :: waited 0.030s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:51:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b728d14-338c-4c9e-af12-ee2cd1cd3d91 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:51:25 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1ea7d0-c336-4a02-8bac-dac34f14bc6f]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:51:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0d1611ae-e9f6-47ad-959c-04b613e008cc tempest-DeleteServersTestJSON-5778723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6d034339-4d72-42fd-bba0-fd81afe5902f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:51:25 devstack sudo[87977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b728d14-338c-4c9e-af12-ee2cd1cd3d91 Sep 21 11:51:25 devstack sudo[87977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:51:25 devstack sudo[87978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6d034339-4d72-42fd-bba0-fd81afe5902f Sep 21 11:51:25 devstack sudo[87978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:51:26 devstack sudo[87977]: pam_unix(sudo:session): session closed for user root Sep 21 11:51:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b728d14-338c-4c9e-af12-ee2cd1cd3d91" returned: 0 in 0.310s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:51:26 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:51:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:51:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb030689-9fa2-4bf3-9d0f-8c20aa622eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b728d14-338c-4c9e-af12-ee2cd1cd3d91', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:51:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d548e74-ee27-4be3-bfe1-a43502f813c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:51:26 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Volume volume-5b728d14-338c-4c9e-af12-ee2cd1cd3d91 (5b728d14-338c-4c9e-af12-ee2cd1cd3d91): created successfully Sep 21 11:51:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d548e74-ee27-4be3-bfe1-a43502f813c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:51:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Flow 'volume_create_manager' (3e9e6408-4c6c-4b1f-87aa-657e1bb2abb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:51:26 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-d2383f21-6d5e-497a-9793-6aca6e2535fb tempest-AttachVolumeShelveTestJSON-470536610 None] Created volume successfully. Sep 21 11:51:26 devstack sudo[87978]: pam_unix(sudo:session): session closed for user root Sep 21 11:51:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0d1611ae-e9f6-47ad-959c-04b613e008cc tempest-DeleteServersTestJSON-5778723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6d034339-4d72-42fd-bba0-fd81afe5902f" returned: 0 in 0.511s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:51:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0d1611ae-e9f6-47ad-959c-04b613e008cc tempest-DeleteServersTestJSON-5778723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6d034339-4d72-42fd-bba0-fd81afe5902f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:51:26 devstack sudo[87987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6d034339-4d72-42fd-bba0-fd81afe5902f Sep 21 11:51:26 devstack sudo[87987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:51:26 devstack sudo[87987]: pam_unix(sudo:session): session closed for user root Sep 21 11:51:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0d1611ae-e9f6-47ad-959c-04b613e008cc tempest-DeleteServersTestJSON-5778723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6d034339-4d72-42fd-bba0-fd81afe5902f" returned: 0 in 0.338s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:51:26 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0d1611ae-e9f6-47ad-959c-04b613e008cc tempest-DeleteServersTestJSON-5778723 None] Lock "cinder-quobyte-6d034339-4d72-42fd-bba0-fd81afe5902f" released by "delete_volume" :: held 0.922s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:51:26 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-0d1611ae-e9f6-47ad-959c-04b613e008cc tempest-DeleteServersTestJSON-5778723 None] Created reservations ['6ad0047e-1cec-4239-9d2b-788d940eee50', '83dea530-b8d4-4480-8cb4-8c0eda8b887a', '75f0a8cd-ee48-45e9-9433-1201f4c9af58', '817b004a-2736-4d11-ba3f-4a2d7fa40b8e'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:51:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0d1611ae-e9f6-47ad-959c-04b613e008cc tempest-DeleteServersTestJSON-5778723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:51:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0d1611ae-e9f6-47ad-959c-04b613e008cc tempest-DeleteServersTestJSON-5778723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:51:26 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0d1611ae-e9f6-47ad-959c-04b613e008cc tempest-DeleteServersTestJSON-5778723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:51:26 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0d1611ae-e9f6-47ad-959c-04b613e008cc tempest-DeleteServersTestJSON-5778723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:51:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0d1611ae-e9f6-47ad-959c-04b613e008cc tempest-DeleteServersTestJSON-5778723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:51:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0d1611ae-e9f6-47ad-959c-04b613e008cc tempest-DeleteServersTestJSON-5778723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:51:26 devstack sudo[87990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:51:26 devstack sudo[87990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:51:27 devstack sudo[87990]: pam_unix(sudo:session): session closed for user root Sep 21 11:51:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0d1611ae-e9f6-47ad-959c-04b613e008cc tempest-DeleteServersTestJSON-5778723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.295s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:51:27 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-0d1611ae-e9f6-47ad-959c-04b613e008cc tempest-DeleteServersTestJSON-5778723 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:51:27 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-0d1611ae-e9f6-47ad-959c-04b613e008cc tempest-DeleteServersTestJSON-5778723 None] Deleted volume successfully. Sep 21 11:51:27 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0d1611ae-e9f6-47ad-959c-04b613e008cc tempest-DeleteServersTestJSON-5778723 None] Lock "cinder-6d034339-4d72-42fd-bba0-fd81afe5902f-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:51:36 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=28,cinder:UPDATE=29,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:51:37 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:UPDATE=24,cinder:SELECT=19,cinder:DELETE=3,cinder:INSERT=7 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:51:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-6071f7d4-9f0d-4a66-a4de-b5aaaf7f3161 req-cec73c56-07c2-46a1-9878-0d1fc419bc1c tempest-AttachVolumeShelveTestJSON-470536610 None] No connector for attachment 14da712c-d31f-4060-9703-8f149c3b19fa; skipping storage backend terminate_connection call. {{(pid=86366) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 21 11:51:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-6071f7d4-9f0d-4a66-a4de-b5aaaf7f3161 req-cec73c56-07c2-46a1-9878-0d1fc419bc1c tempest-AttachVolumeShelveTestJSON-470536610 None] Deleting attachment 14da712c-d31f-4060-9703-8f149c3b19fa. {{(pid=86366) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 11:51:55 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=2 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:51:55 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:52:03 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 11:52:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:52:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:52:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:52:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:52:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:52:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:52:03 devstack sudo[88129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:52:03 devstack sudo[88129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:52:04 devstack sudo[88129]: pam_unix(sudo:session): session closed for user root Sep 21 11:52:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.734s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:52:04 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:52:04 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 11:52:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread count: 8 {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 11:52:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread info: [<_MainThread(MainThread, started 132841976594560)>, , , , , , , ] {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 11:52:35 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:52:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Flow 'volume_create_manager' (16898906-5d5f-49cd-8022-e89e7a17d668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:52:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06bb9895-a73e-400d-ba12-a64dc8010181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:52:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06bb9895-a73e-400d-ba12-a64dc8010181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1061540571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4bafda3-f09f-4fe8-a164-fd84e5eb5003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e3e2d0cf49402897930aa4db95efd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:52:35Z,use_quota=True,user_id='d52b8d70f79348bb8f147fb9418c6173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:52:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2bd6b6-d236-4f81-b1a9-39ddcbf24ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:52:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2bd6b6-d236-4f81-b1a9-39ddcbf24ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:52:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57abac46-0681-41f5-a1c1-db167c7b5ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:52:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57abac46-0681-41f5-a1c1-db167c7b5ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4bafda3-f09f-4fe8-a164-fd84e5eb5003', 'volume_name': 'volume-a4bafda3-f09f-4fe8-a164-fd84e5eb5003', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:52:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af8a3805-b4c4-4030-8c21-639a2d47f871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:52:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af8a3805-b4c4-4030-8c21-639a2d47f871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:52:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d30a65-8b3c-4992-91b4-020de317842a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:52:35 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Volume a4bafda3-f09f-4fe8-a164-fd84e5eb5003: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4bafda3-f09f-4fe8-a164-fd84e5eb5003', 'volume_size': 1} Sep 21 11:52:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:52:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:52:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1061540571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4bafda3-f09f-4fe8-a164-fd84e5eb5003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96e3e2d0cf49402897930aa4db95efd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:52:35Z,use_quota=True,user_id='d52b8d70f79348bb8f147fb9418c6173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:52:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Creating volume a4bafda3-f09f-4fe8-a164-fd84e5eb5003 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:52:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:52:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:52:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:52:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:52:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:52:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:52:35 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:52:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4bafda3-f09f-4fe8-a164-fd84e5eb5003 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:52:35 devstack sudo[88442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4bafda3-f09f-4fe8-a164-fd84e5eb5003 1073741824 Sep 21 11:52:35 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:52:35 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root Sep 21 11:52:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4bafda3-f09f-4fe8-a164-fd84e5eb5003 1073741824" returned: 0 in 0.728s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:52:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4bafda3-f09f-4fe8-a164-fd84e5eb5003 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:52:36 devstack sudo[88469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4bafda3-f09f-4fe8-a164-fd84e5eb5003 Sep 21 11:52:36 devstack sudo[88469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:52:36 devstack sudo[88469]: pam_unix(sudo:session): session closed for user root Sep 21 11:52:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4bafda3-f09f-4fe8-a164-fd84e5eb5003" returned: 0 in 0.275s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:52:36 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:52:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:52:36 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d30a65-8b3c-4992-91b4-020de317842a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4bafda3-f09f-4fe8-a164-fd84e5eb5003', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:52:36 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce09abd-16f4-4864-b0cc-5823d523a2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:52:36 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Volume volume-a4bafda3-f09f-4fe8-a164-fd84e5eb5003 (a4bafda3-f09f-4fe8-a164-fd84e5eb5003): created successfully Sep 21 11:52:36 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce09abd-16f4-4864-b0cc-5823d523a2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:52:36 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Flow 'volume_create_manager' (16898906-5d5f-49cd-8022-e89e7a17d668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:52:36 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-c4cac1b5-d386-4834-8aaf-4504a6886227 tempest-TaggedAttachmentsTest-115675560 None] Created volume successfully. Sep 21 11:52:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2d4332f4-40f1-4495-b684-f492eb8b9169 tempest-AttachVolumeShelveTestJSON-470536610 None] Acquiring lock "cinder-5b728d14-338c-4c9e-af12-ee2cd1cd3d91-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:52:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2d4332f4-40f1-4495-b684-f492eb8b9169 tempest-AttachVolumeShelveTestJSON-470536610 None] Lock "cinder-5b728d14-338c-4c9e-af12-ee2cd1cd3d91-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:52:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2d4332f4-40f1-4495-b684-f492eb8b9169 tempest-AttachVolumeShelveTestJSON-470536610 None] Acquiring lock "cinder-quobyte-5b728d14-338c-4c9e-af12-ee2cd1cd3d91" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:52:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2d4332f4-40f1-4495-b684-f492eb8b9169 tempest-AttachVolumeShelveTestJSON-470536610 None] Lock "cinder-quobyte-5b728d14-338c-4c9e-af12-ee2cd1cd3d91" acquired by "delete_volume" :: waited 0.035s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:52:42 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df117ab-3029-4375-ad4d-b551eeab7355]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:52:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2d4332f4-40f1-4495-b684-f492eb8b9169 tempest-AttachVolumeShelveTestJSON-470536610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b728d14-338c-4c9e-af12-ee2cd1cd3d91 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:52:43 devstack sudo[88610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b728d14-338c-4c9e-af12-ee2cd1cd3d91 Sep 21 11:52:43 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:52:43 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root Sep 21 11:52:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2d4332f4-40f1-4495-b684-f492eb8b9169 tempest-AttachVolumeShelveTestJSON-470536610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b728d14-338c-4c9e-af12-ee2cd1cd3d91" returned: 0 in 0.719s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:52:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2d4332f4-40f1-4495-b684-f492eb8b9169 tempest-AttachVolumeShelveTestJSON-470536610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b728d14-338c-4c9e-af12-ee2cd1cd3d91 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:52:43 devstack sudo[88619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b728d14-338c-4c9e-af12-ee2cd1cd3d91 Sep 21 11:52:43 devstack sudo[88619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:52:44 devstack sudo[88619]: pam_unix(sudo:session): session closed for user root Sep 21 11:52:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2d4332f4-40f1-4495-b684-f492eb8b9169 tempest-AttachVolumeShelveTestJSON-470536610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b728d14-338c-4c9e-af12-ee2cd1cd3d91" returned: 0 in 0.346s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:52:44 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2d4332f4-40f1-4495-b684-f492eb8b9169 tempest-AttachVolumeShelveTestJSON-470536610 None] Lock "cinder-quobyte-5b728d14-338c-4c9e-af12-ee2cd1cd3d91" released by "delete_volume" :: held 1.161s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:52:44 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-2d4332f4-40f1-4495-b684-f492eb8b9169 tempest-AttachVolumeShelveTestJSON-470536610 None] Created reservations ['06246732-51ad-4771-a11d-5a625fc65869', '6a2cddfc-a0b8-4249-b21a-9c0152c5c04c', '4cbfa961-83c5-4bb8-ba7a-b921aaff9fb5', '5d1c69f2-e70a-45bd-8f19-69026c229739'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:52:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2d4332f4-40f1-4495-b684-f492eb8b9169 tempest-AttachVolumeShelveTestJSON-470536610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:52:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2d4332f4-40f1-4495-b684-f492eb8b9169 tempest-AttachVolumeShelveTestJSON-470536610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:52:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2d4332f4-40f1-4495-b684-f492eb8b9169 tempest-AttachVolumeShelveTestJSON-470536610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:52:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2d4332f4-40f1-4495-b684-f492eb8b9169 tempest-AttachVolumeShelveTestJSON-470536610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:52:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2d4332f4-40f1-4495-b684-f492eb8b9169 tempest-AttachVolumeShelveTestJSON-470536610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:52:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2d4332f4-40f1-4495-b684-f492eb8b9169 tempest-AttachVolumeShelveTestJSON-470536610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:52:44 devstack sudo[88633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:52:44 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:52:44 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root Sep 21 11:52:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2d4332f4-40f1-4495-b684-f492eb8b9169 tempest-AttachVolumeShelveTestJSON-470536610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.415s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:52:44 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-2d4332f4-40f1-4495-b684-f492eb8b9169 tempest-AttachVolumeShelveTestJSON-470536610 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:52:44 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-2d4332f4-40f1-4495-b684-f492eb8b9169 tempest-AttachVolumeShelveTestJSON-470536610 None] Deleted volume successfully. Sep 21 11:52:44 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2d4332f4-40f1-4495-b684-f492eb8b9169 tempest-AttachVolumeShelveTestJSON-470536610 None] Lock "cinder-5b728d14-338c-4c9e-af12-ee2cd1cd3d91-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:52:48 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:52:48 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Flow 'volume_create_manager' (40a9b807-1243-4004-872a-7c9237d2dcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:52:48 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a0e352e-cc1a-40c9-937c-df5fd0a0bdf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:52:48 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a0e352e-cc1a-40c9-937c-df5fd0a0bdf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1273109748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ee8809-700b-40ca-81cb-1f7c83606f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1724e5bb6794fc8bb9e4b1bca35d859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:52:48Z,use_quota=True,user_id='b2d2b228a41c439883ed60c78a440e07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:52:48 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d659f04-6733-4a21-bd05-9b8546a85434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:52:48 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d659f04-6733-4a21-bd05-9b8546a85434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:52:48 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb9a9f5-f783-46c1-a1a3-376d088493b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:52:48 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb9a9f5-f783-46c1-a1a3-376d088493b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4ee8809-700b-40ca-81cb-1f7c83606f85', 'volume_name': 'volume-c4ee8809-700b-40ca-81cb-1f7c83606f85', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:52:48 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686b530c-92a1-434d-a0c8-48305ca6648d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:52:48 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686b530c-92a1-434d-a0c8-48305ca6648d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:52:48 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b0e646e-d0cf-46ec-8e9d-def823e507c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:52:48 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Volume c4ee8809-700b-40ca-81cb-1f7c83606f85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4ee8809-700b-40ca-81cb-1f7c83606f85', 'volume_size': 1} Sep 21 11:52:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:52:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:52:48 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:52:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1273109748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4ee8809-700b-40ca-81cb-1f7c83606f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1724e5bb6794fc8bb9e4b1bca35d859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:52:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:52:48Z,use_quota=True,user_id='b2d2b228a41c439883ed60c78a440e07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:52:48 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Creating volume c4ee8809-700b-40ca-81cb-1f7c83606f85 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:52:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:52:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:52:48 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:52:48 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:52:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:52:48 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:52:48 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:52:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c4ee8809-700b-40ca-81cb-1f7c83606f85 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:52:48 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c4ee8809-700b-40ca-81cb-1f7c83606f85 1073741824 Sep 21 11:52:48 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:52:49 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Sep 21 11:52:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c4ee8809-700b-40ca-81cb-1f7c83606f85 1073741824" returned: 0 in 0.546s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:52:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c4ee8809-700b-40ca-81cb-1f7c83606f85 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:52:49 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c4ee8809-700b-40ca-81cb-1f7c83606f85 Sep 21 11:52:49 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:52:49 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Sep 21 11:52:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c4ee8809-700b-40ca-81cb-1f7c83606f85" returned: 0 in 0.400s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:52:49 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:52:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:52:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b0e646e-d0cf-46ec-8e9d-def823e507c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4ee8809-700b-40ca-81cb-1f7c83606f85', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:52:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6491b16d-6b9e-4981-a0f5-4a4b95867432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:52:49 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Volume volume-c4ee8809-700b-40ca-81cb-1f7c83606f85 (c4ee8809-700b-40ca-81cb-1f7c83606f85): created successfully Sep 21 11:52:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6491b16d-6b9e-4981-a0f5-4a4b95867432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:52:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Flow 'volume_create_manager' (40a9b807-1243-4004-872a-7c9237d2dcf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:52:49 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-2f7118a5-7169-40df-adbb-b1b9f1aac6a9 tempest-AttachVolumeNegativeTest-1753132709 None] Created volume successfully. Sep 21 11:52:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-1abc437d-087d-4078-ad5c-701798f4eb61 req-0f7ea26a-2b46-46d7-a924-683e0bdc79ee tempest-AttachVolumeNegativeTest-1753132709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:52:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-1abc437d-087d-4078-ad5c-701798f4eb61 req-0f7ea26a-2b46-46d7-a924-683e0bdc79ee tempest-AttachVolumeNegativeTest-1753132709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:52:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-1abc437d-087d-4078-ad5c-701798f4eb61 req-0f7ea26a-2b46-46d7-a924-683e0bdc79ee tempest-AttachVolumeNegativeTest-1753132709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:52:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-1abc437d-087d-4078-ad5c-701798f4eb61 req-0f7ea26a-2b46-46d7-a924-683e0bdc79ee tempest-AttachVolumeNegativeTest-1753132709 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d', 'name': 'volume-c4ee8809-700b-40ca-81cb-1f7c83606f85', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f7db9529-bbd0-4e3f-ae95-8fc4298cc9e3', 'enforce_multipath': True} {{(pid=86366) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 11:52:51 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-1abc437d-087d-4078-ad5c-701798f4eb61 req-0f7ea26a-2b46-46d7-a924-683e0bdc79ee tempest-AttachVolumeNegativeTest-1753132709 None] attachment_update completed successfully. Sep 21 11:52:56 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:52:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Flow 'volume_create_manager' (af40d388-0015-470c-b71f-e360ea0f7a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:52:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6ce1fc-b430-4cbb-818b-70043a4457a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:52:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6ce1fc-b430-4cbb-818b-70043a4457a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1260489616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b3627d-b359-4f43-b9ef-1323cbbd6cf0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dc12a7488833453cba227dbb23107bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:52:56Z,use_quota=True,user_id='ce12b8b50be04289b2b69d2a9a220bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:52:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a9fec5-b836-445d-abd5-99543118b0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:52:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a9fec5-b836-445d-abd5-99543118b0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:52:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (469a122c-22ff-4598-86ec-20abe4088920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:52:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (469a122c-22ff-4598-86ec-20abe4088920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9b3627d-b359-4f43-b9ef-1323cbbd6cf0', 'volume_name': 'volume-a9b3627d-b359-4f43-b9ef-1323cbbd6cf0', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:52:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62fd159-7119-4dd0-8849-50036c6f3a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:52:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62fd159-7119-4dd0-8849-50036c6f3a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:52:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fde3386-f18c-41b0-9350-6cd7cbd2cb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:52:56 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Volume a9b3627d-b359-4f43-b9ef-1323cbbd6cf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9b3627d-b359-4f43-b9ef-1323cbbd6cf0', 'volume_size': 1} Sep 21 11:52:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:52:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:52:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1260489616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b3627d-b359-4f43-b9ef-1323cbbd6cf0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dc12a7488833453cba227dbb23107bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:52:56Z,use_quota=True,user_id='ce12b8b50be04289b2b69d2a9a220bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:52:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Creating volume a9b3627d-b359-4f43-b9ef-1323cbbd6cf0 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:52:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:52:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:52:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:52:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:52:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:52:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:52:56 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:52:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a9b3627d-b359-4f43-b9ef-1323cbbd6cf0 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:52:56 devstack sudo[89154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a9b3627d-b359-4f43-b9ef-1323cbbd6cf0 1073741824 Sep 21 11:52:56 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:52:57 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root Sep 21 11:52:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a9b3627d-b359-4f43-b9ef-1323cbbd6cf0 1073741824" returned: 0 in 0.628s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:52:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a9b3627d-b359-4f43-b9ef-1323cbbd6cf0 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:52:57 devstack sudo[89165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a9b3627d-b359-4f43-b9ef-1323cbbd6cf0 Sep 21 11:52:57 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:52:57 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root Sep 21 11:52:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a9b3627d-b359-4f43-b9ef-1323cbbd6cf0" returned: 0 in 0.378s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:52:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:52:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:52:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fde3386-f18c-41b0-9350-6cd7cbd2cb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9b3627d-b359-4f43-b9ef-1323cbbd6cf0', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:52:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661e2649-2fd9-4131-8cd7-b6cb423a523f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:52:57 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Volume volume-a9b3627d-b359-4f43-b9ef-1323cbbd6cf0 (a9b3627d-b359-4f43-b9ef-1323cbbd6cf0): created successfully Sep 21 11:52:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661e2649-2fd9-4131-8cd7-b6cb423a523f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:52:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Flow 'volume_create_manager' (af40d388-0015-470c-b71f-e360ea0f7a28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:52:57 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-6e9188d7-ce28-4b3e-91dc-de7e71501d2f tempest-VolumesTestJSON-368005012 None] Created volume successfully. Sep 21 11:52:58 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:52:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Flow 'volume_create_manager' (61438976-3f1e-4fdb-a0c7-cd132855cb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:52:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a809273d-174c-4dcf-b01c-34c64a7a12aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:52:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a809273d-174c-4dcf-b01c-34c64a7a12aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1471728017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1025f83-1946-4609-84ff-0ceb47818c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a866f85ad3194ff7854b228c3f0a750b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:52:59Z,use_quota=True,user_id='9eb47b243a624d2d98aef1b57aada116',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:52:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9337eaa4-caba-4c30-b469-e8161d3d1dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:52:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9337eaa4-caba-4c30-b469-e8161d3d1dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:52:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c96fa6c-b022-41b0-a2dd-ed039a2bb24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:52:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c96fa6c-b022-41b0-a2dd-ed039a2bb24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1025f83-1946-4609-84ff-0ceb47818c4b', 'volume_name': 'volume-c1025f83-1946-4609-84ff-0ceb47818c4b', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:52:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f8e5c2a-d564-4054-9963-299608ce2295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:52:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f8e5c2a-d564-4054-9963-299608ce2295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:52:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d638dc17-6b78-44dd-a0cf-6a03ffc6d943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:52:58 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Volume c1025f83-1946-4609-84ff-0ceb47818c4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1025f83-1946-4609-84ff-0ceb47818c4b', 'volume_size': 1} Sep 21 11:52:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:52:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:52:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1471728017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1025f83-1946-4609-84ff-0ceb47818c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a866f85ad3194ff7854b228c3f0a750b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:52:59Z,use_quota=True,user_id='9eb47b243a624d2d98aef1b57aada116',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:52:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Creating volume c1025f83-1946-4609-84ff-0ceb47818c4b {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:52:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:52:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:52:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:52:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:52:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:52:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:52:58 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:52:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c1025f83-1946-4609-84ff-0ceb47818c4b 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:52:58 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c1025f83-1946-4609-84ff-0ceb47818c4b 1073741824 Sep 21 11:52:58 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:00 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c1025f83-1946-4609-84ff-0ceb47818c4b 1073741824" returned: 0 in 1.195s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Flow 'volume_create_manager' (6bafec4e-a10f-41a9-9ca8-4fbce79d1dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b088597-ad3a-455c-b49f-40a34a703b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c1025f83-1946-4609-84ff-0ceb47818c4b {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b088597-ad3a-455c-b49f-40a34a703b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1853880645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1929089c-9a53-4527-a598-0e2fc60efff3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dc12a7488833453cba227dbb23107bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:53:00Z,use_quota=True,user_id='ce12b8b50be04289b2b69d2a9a220bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e2b2fe-d322-4e05-840a-2e344bf9f2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08e2b2fe-d322-4e05-840a-2e344bf9f2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6deee0fe-691a-4b50-b68a-bde93dbd1a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6deee0fe-691a-4b50-b68a-bde93dbd1a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1929089c-9a53-4527-a598-0e2fc60efff3', 'volume_name': 'volume-1929089c-9a53-4527-a598-0e2fc60efff3', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05fea914-0625-404a-8e9f-dced7bc55d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05fea914-0625-404a-8e9f-dced7bc55d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82860b89-927f-409a-8f22-6ac34939fb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:53:00 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Volume 1929089c-9a53-4527-a598-0e2fc60efff3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1929089c-9a53-4527-a598-0e2fc60efff3', 'volume_size': 1} Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:53:00 devstack sudo[89197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c1025f83-1946-4609-84ff-0ceb47818c4b Sep 21 11:53:00 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:00 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c1025f83-1946-4609-84ff-0ceb47818c4b" returned: 0 in 0.456s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.393s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1853880645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1929089c-9a53-4527-a598-0e2fc60efff3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dc12a7488833453cba227dbb23107bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:53:00Z,use_quota=True,user_id='ce12b8b50be04289b2b69d2a9a220bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Creating volume 1929089c-9a53-4527-a598-0e2fc60efff3 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:53:00 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1929089c-9a53-4527-a598-0e2fc60efff3 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:00 devstack sudo[89204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1929089c-9a53-4527-a598-0e2fc60efff3 1073741824 Sep 21 11:53:00 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d638dc17-6b78-44dd-a0cf-6a03ffc6d943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1025f83-1946-4609-84ff-0ceb47818c4b', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c38c18-1680-4353-80b1-15fb4aea10cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:53:00 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Volume volume-c1025f83-1946-4609-84ff-0ceb47818c4b (c1025f83-1946-4609-84ff-0ceb47818c4b): created successfully Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2c38c18-1680-4353-80b1-15fb4aea10cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:53:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Flow 'volume_create_manager' (61438976-3f1e-4fdb-a0c7-cd132855cb1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:53:00 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1931ab5c-3ece-4709-8d6f-252824f80e0c tempest-ServerActionsTestOtherA-1757437079 None] Created volume successfully. Sep 21 11:53:01 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1929089c-9a53-4527-a598-0e2fc60efff3 1073741824" returned: 0 in 0.660s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1929089c-9a53-4527-a598-0e2fc60efff3 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:01 devstack sudo[89210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1929089c-9a53-4527-a598-0e2fc60efff3 Sep 21 11:53:01 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:01 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1929089c-9a53-4527-a598-0e2fc60efff3" returned: 0 in 0.521s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:53:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:53:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82860b89-927f-409a-8f22-6ac34939fb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1929089c-9a53-4527-a598-0e2fc60efff3', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:53:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f2ea845-83aa-42fe-b628-d701b9e25468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:53:01 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Volume volume-1929089c-9a53-4527-a598-0e2fc60efff3 (1929089c-9a53-4527-a598-0e2fc60efff3): created successfully Sep 21 11:53:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f2ea845-83aa-42fe-b628-d701b9e25468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:53:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Flow 'volume_create_manager' (6bafec4e-a10f-41a9-9ca8-4fbce79d1dc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:53:02 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1cb6608b-c3da-41fa-974c-b4a8aab649d0 tempest-VolumesTestJSON-368005012 None] Created volume successfully. Sep 21 11:53:03 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 11:53:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:53:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:53:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:53:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:53:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:53:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:03 devstack sudo[89269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:53:03 devstack sudo[89269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:04 devstack sudo[89269]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.556s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:04 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:53:04 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:53:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Flow 'volume_create_manager' (8d49e6f8-fa19-4eed-a175-2484b5a39140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:53:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7fa620f-779f-4a11-ab3a-c6afd7a567a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:53:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7fa620f-779f-4a11-ab3a-c6afd7a567a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1233594112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa48018-fef7-4b5c-9158-8967e86b81b6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dc12a7488833453cba227dbb23107bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:53:04Z,use_quota=True,user_id='ce12b8b50be04289b2b69d2a9a220bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:53:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044e232d-08ef-4363-9c3e-4545a1a9e2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:53:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044e232d-08ef-4363-9c3e-4545a1a9e2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:53:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (109da3e5-2abe-4347-818a-bb153d6b71b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:53:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (109da3e5-2abe-4347-818a-bb153d6b71b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aa48018-fef7-4b5c-9158-8967e86b81b6', 'volume_name': 'volume-1aa48018-fef7-4b5c-9158-8967e86b81b6', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:53:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980efa70-fe6b-4ec4-8761-c2ff508de823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:53:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980efa70-fe6b-4ec4-8761-c2ff508de823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:53:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39713c1e-aa5e-43d6-9d10-2c71ceb6f63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:53:04 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Volume 1aa48018-fef7-4b5c-9158-8967e86b81b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aa48018-fef7-4b5c-9158-8967e86b81b6', 'volume_size': 1} Sep 21 11:53:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:53:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:53:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1233594112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aa48018-fef7-4b5c-9158-8967e86b81b6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dc12a7488833453cba227dbb23107bed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:53:04Z,use_quota=True,user_id='ce12b8b50be04289b2b69d2a9a220bf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:53:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Creating volume 1aa48018-fef7-4b5c-9158-8967e86b81b6 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:53:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:53:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:53:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:53:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:53:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:53:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:53:04 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:53:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1aa48018-fef7-4b5c-9158-8967e86b81b6 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:04 devstack sudo[89287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1aa48018-fef7-4b5c-9158-8967e86b81b6 1073741824 Sep 21 11:53:04 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:05 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1aa48018-fef7-4b5c-9158-8967e86b81b6 1073741824" returned: 0 in 1.039s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1aa48018-fef7-4b5c-9158-8967e86b81b6 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:05 devstack sudo[89296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1aa48018-fef7-4b5c-9158-8967e86b81b6 Sep 21 11:53:05 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:06 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1aa48018-fef7-4b5c-9158-8967e86b81b6" returned: 0 in 0.479s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:06 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:53:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:53:06 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39713c1e-aa5e-43d6-9d10-2c71ceb6f63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aa48018-fef7-4b5c-9158-8967e86b81b6', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:53:06 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dbda268-39b3-4a0d-b6d2-d88db37aa4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:53:06 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Volume volume-1aa48018-fef7-4b5c-9158-8967e86b81b6 (1aa48018-fef7-4b5c-9158-8967e86b81b6): created successfully Sep 21 11:53:06 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dbda268-39b3-4a0d-b6d2-d88db37aa4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:53:06 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Flow 'volume_create_manager' (8d49e6f8-fa19-4eed-a175-2484b5a39140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:53:06 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-de892829-4723-45ff-98e9-3f83233fddca tempest-VolumesTestJSON-368005012 None] Created volume successfully. Sep 21 11:53:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b53f9f3d-9525-45cf-997a-cb0d40cd345b tempest-VolumesTestJSON-368005012 None] Acquiring lock "cinder-1aa48018-fef7-4b5c-9158-8967e86b81b6-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:53:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b53f9f3d-9525-45cf-997a-cb0d40cd345b tempest-VolumesTestJSON-368005012 None] Lock "cinder-1aa48018-fef7-4b5c-9158-8967e86b81b6-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:53:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b53f9f3d-9525-45cf-997a-cb0d40cd345b tempest-VolumesTestJSON-368005012 None] Acquiring lock "cinder-quobyte-1aa48018-fef7-4b5c-9158-8967e86b81b6" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:53:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b53f9f3d-9525-45cf-997a-cb0d40cd345b tempest-VolumesTestJSON-368005012 None] Lock "cinder-quobyte-1aa48018-fef7-4b5c-9158-8967e86b81b6" acquired by "delete_volume" :: waited 0.023s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:53:09 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05d22d8-70e8-493c-9d77-83a1356033b4]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:53:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b53f9f3d-9525-45cf-997a-cb0d40cd345b tempest-VolumesTestJSON-368005012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1aa48018-fef7-4b5c-9158-8967e86b81b6 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:09 devstack sudo[89320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1aa48018-fef7-4b5c-9158-8967e86b81b6 Sep 21 11:53:09 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:10 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b53f9f3d-9525-45cf-997a-cb0d40cd345b tempest-VolumesTestJSON-368005012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1aa48018-fef7-4b5c-9158-8967e86b81b6" returned: 0 in 0.659s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b53f9f3d-9525-45cf-997a-cb0d40cd345b tempest-VolumesTestJSON-368005012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1aa48018-fef7-4b5c-9158-8967e86b81b6 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:10 devstack sudo[89327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1aa48018-fef7-4b5c-9158-8967e86b81b6 Sep 21 11:53:10 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:10 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b53f9f3d-9525-45cf-997a-cb0d40cd345b tempest-VolumesTestJSON-368005012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1aa48018-fef7-4b5c-9158-8967e86b81b6" returned: 0 in 0.364s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:10 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b53f9f3d-9525-45cf-997a-cb0d40cd345b tempest-VolumesTestJSON-368005012 None] Lock "cinder-quobyte-1aa48018-fef7-4b5c-9158-8967e86b81b6" released by "delete_volume" :: held 1.144s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:53:10 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-b53f9f3d-9525-45cf-997a-cb0d40cd345b tempest-VolumesTestJSON-368005012 None] Created reservations ['f08e4598-acfd-4607-b888-f1fff05b540c', '0c7dfbfa-27f8-41e7-8756-15eab98e2451', '0cad79df-7e79-4931-8393-9cc921b56e5d', 'bb61554f-7b59-4ef0-943b-592410d2c86a'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:53:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b53f9f3d-9525-45cf-997a-cb0d40cd345b tempest-VolumesTestJSON-368005012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:53:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b53f9f3d-9525-45cf-997a-cb0d40cd345b tempest-VolumesTestJSON-368005012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:53:10 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b53f9f3d-9525-45cf-997a-cb0d40cd345b tempest-VolumesTestJSON-368005012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:53:10 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b53f9f3d-9525-45cf-997a-cb0d40cd345b tempest-VolumesTestJSON-368005012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:53:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b53f9f3d-9525-45cf-997a-cb0d40cd345b tempest-VolumesTestJSON-368005012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:53:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b53f9f3d-9525-45cf-997a-cb0d40cd345b tempest-VolumesTestJSON-368005012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:10 devstack sudo[89331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:53:10 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:11 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b53f9f3d-9525-45cf-997a-cb0d40cd345b tempest-VolumesTestJSON-368005012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.690s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:11 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-b53f9f3d-9525-45cf-997a-cb0d40cd345b tempest-VolumesTestJSON-368005012 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:53:11 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-b53f9f3d-9525-45cf-997a-cb0d40cd345b tempest-VolumesTestJSON-368005012 None] Deleted volume successfully. Sep 21 11:53:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b53f9f3d-9525-45cf-997a-cb0d40cd345b tempest-VolumesTestJSON-368005012 None] Lock "cinder-1aa48018-fef7-4b5c-9158-8967e86b81b6-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:53:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e96fbfcb-7bcd-4150-9123-2e7ad99c0581 tempest-VolumesTestJSON-368005012 None] Acquiring lock "cinder-1929089c-9a53-4527-a598-0e2fc60efff3-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:53:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e96fbfcb-7bcd-4150-9123-2e7ad99c0581 tempest-VolumesTestJSON-368005012 None] Lock "cinder-1929089c-9a53-4527-a598-0e2fc60efff3-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:53:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e96fbfcb-7bcd-4150-9123-2e7ad99c0581 tempest-VolumesTestJSON-368005012 None] Acquiring lock "cinder-quobyte-1929089c-9a53-4527-a598-0e2fc60efff3" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:53:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e96fbfcb-7bcd-4150-9123-2e7ad99c0581 tempest-VolumesTestJSON-368005012 None] Lock "cinder-quobyte-1929089c-9a53-4527-a598-0e2fc60efff3" acquired by "delete_volume" :: waited 0.045s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:53:12 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee66b1a0-ac98-424f-b838-c5bfb896fdd6]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:53:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e96fbfcb-7bcd-4150-9123-2e7ad99c0581 tempest-VolumesTestJSON-368005012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1929089c-9a53-4527-a598-0e2fc60efff3 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:12 devstack sudo[89400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1929089c-9a53-4527-a598-0e2fc60efff3 Sep 21 11:53:12 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:13 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e96fbfcb-7bcd-4150-9123-2e7ad99c0581 tempest-VolumesTestJSON-368005012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1929089c-9a53-4527-a598-0e2fc60efff3" returned: 0 in 1.003s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e96fbfcb-7bcd-4150-9123-2e7ad99c0581 tempest-VolumesTestJSON-368005012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1929089c-9a53-4527-a598-0e2fc60efff3 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:13 devstack sudo[89409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1929089c-9a53-4527-a598-0e2fc60efff3 Sep 21 11:53:13 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:13 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e96fbfcb-7bcd-4150-9123-2e7ad99c0581 tempest-VolumesTestJSON-368005012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1929089c-9a53-4527-a598-0e2fc60efff3" returned: 0 in 0.552s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:13 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e96fbfcb-7bcd-4150-9123-2e7ad99c0581 tempest-VolumesTestJSON-368005012 None] Lock "cinder-quobyte-1929089c-9a53-4527-a598-0e2fc60efff3" released by "delete_volume" :: held 1.700s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:53:13 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-e96fbfcb-7bcd-4150-9123-2e7ad99c0581 tempest-VolumesTestJSON-368005012 None] Created reservations ['a0e06891-88ec-4460-8d6e-0aac3a4062b2', '0f06c615-8883-4db3-87a3-1cdb122bccbf', '5a915a18-7efd-417f-8aa9-6dfe67d5afa2', '1267036a-b98f-4eb4-bd18-80639fc0e09e'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:53:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e96fbfcb-7bcd-4150-9123-2e7ad99c0581 tempest-VolumesTestJSON-368005012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:53:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e96fbfcb-7bcd-4150-9123-2e7ad99c0581 tempest-VolumesTestJSON-368005012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:53:13 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e96fbfcb-7bcd-4150-9123-2e7ad99c0581 tempest-VolumesTestJSON-368005012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:53:13 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e96fbfcb-7bcd-4150-9123-2e7ad99c0581 tempest-VolumesTestJSON-368005012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:53:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e96fbfcb-7bcd-4150-9123-2e7ad99c0581 tempest-VolumesTestJSON-368005012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:53:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e96fbfcb-7bcd-4150-9123-2e7ad99c0581 tempest-VolumesTestJSON-368005012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:13 devstack sudo[89413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:53:13 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:14 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e96fbfcb-7bcd-4150-9123-2e7ad99c0581 tempest-VolumesTestJSON-368005012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.316s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:14 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-e96fbfcb-7bcd-4150-9123-2e7ad99c0581 tempest-VolumesTestJSON-368005012 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:53:14 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-e96fbfcb-7bcd-4150-9123-2e7ad99c0581 tempest-VolumesTestJSON-368005012 None] Deleted volume successfully. Sep 21 11:53:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e96fbfcb-7bcd-4150-9123-2e7ad99c0581 tempest-VolumesTestJSON-368005012 None] Lock "cinder-1929089c-9a53-4527-a598-0e2fc60efff3-delete_volume" released by "delete_volume" :: held 2.413s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:53:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1ca48d06-28e8-4868-a7b5-b71f9f64b6f1 tempest-VolumesTestJSON-368005012 None] Acquiring lock "cinder-a9b3627d-b359-4f43-b9ef-1323cbbd6cf0-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:53:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1ca48d06-28e8-4868-a7b5-b71f9f64b6f1 tempest-VolumesTestJSON-368005012 None] Lock "cinder-a9b3627d-b359-4f43-b9ef-1323cbbd6cf0-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:53:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1ca48d06-28e8-4868-a7b5-b71f9f64b6f1 tempest-VolumesTestJSON-368005012 None] Acquiring lock "cinder-quobyte-a9b3627d-b359-4f43-b9ef-1323cbbd6cf0" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:53:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1ca48d06-28e8-4868-a7b5-b71f9f64b6f1 tempest-VolumesTestJSON-368005012 None] Lock "cinder-quobyte-a9b3627d-b359-4f43-b9ef-1323cbbd6cf0" acquired by "delete_volume" :: waited 0.042s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:53:14 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd777bca-a152-4d58-9fa3-15f4b475b185]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:53:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1ca48d06-28e8-4868-a7b5-b71f9f64b6f1 tempest-VolumesTestJSON-368005012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a9b3627d-b359-4f43-b9ef-1323cbbd6cf0 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:15 devstack sudo[89419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a9b3627d-b359-4f43-b9ef-1323cbbd6cf0 Sep 21 11:53:15 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:15 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1ca48d06-28e8-4868-a7b5-b71f9f64b6f1 tempest-VolumesTestJSON-368005012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a9b3627d-b359-4f43-b9ef-1323cbbd6cf0" returned: 0 in 0.981s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1ca48d06-28e8-4868-a7b5-b71f9f64b6f1 tempest-VolumesTestJSON-368005012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a9b3627d-b359-4f43-b9ef-1323cbbd6cf0 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:15 devstack sudo[89424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a9b3627d-b359-4f43-b9ef-1323cbbd6cf0 Sep 21 11:53:15 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:16 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1ca48d06-28e8-4868-a7b5-b71f9f64b6f1 tempest-VolumesTestJSON-368005012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a9b3627d-b359-4f43-b9ef-1323cbbd6cf0" returned: 0 in 0.391s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:16 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1ca48d06-28e8-4868-a7b5-b71f9f64b6f1 tempest-VolumesTestJSON-368005012 None] Lock "cinder-quobyte-a9b3627d-b359-4f43-b9ef-1323cbbd6cf0" released by "delete_volume" :: held 1.468s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:53:16 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-1ca48d06-28e8-4868-a7b5-b71f9f64b6f1 tempest-VolumesTestJSON-368005012 None] Created reservations ['780a9981-16d2-4e20-98c4-c1bfe9b3e3ed', '5202f2ea-ed2c-4f88-993d-67027a73acb0', '9c3bd10e-0479-4854-a4eb-5ad56de070ef', '6bbc2816-5dcf-4c7c-b259-b035c2edef8d'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:53:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1ca48d06-28e8-4868-a7b5-b71f9f64b6f1 tempest-VolumesTestJSON-368005012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:53:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1ca48d06-28e8-4868-a7b5-b71f9f64b6f1 tempest-VolumesTestJSON-368005012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:53:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1ca48d06-28e8-4868-a7b5-b71f9f64b6f1 tempest-VolumesTestJSON-368005012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:53:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1ca48d06-28e8-4868-a7b5-b71f9f64b6f1 tempest-VolumesTestJSON-368005012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:53:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1ca48d06-28e8-4868-a7b5-b71f9f64b6f1 tempest-VolumesTestJSON-368005012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:53:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1ca48d06-28e8-4868-a7b5-b71f9f64b6f1 tempest-VolumesTestJSON-368005012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:16 devstack sudo[89427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:53:16 devstack sudo[89427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:16 devstack sudo[89427]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1ca48d06-28e8-4868-a7b5-b71f9f64b6f1 tempest-VolumesTestJSON-368005012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.303s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:16 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-1ca48d06-28e8-4868-a7b5-b71f9f64b6f1 tempest-VolumesTestJSON-368005012 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:53:16 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1ca48d06-28e8-4868-a7b5-b71f9f64b6f1 tempest-VolumesTestJSON-368005012 None] Deleted volume successfully. Sep 21 11:53:16 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1ca48d06-28e8-4868-a7b5-b71f9f64b6f1 tempest-VolumesTestJSON-368005012 None] Lock "cinder-a9b3627d-b359-4f43-b9ef-1323cbbd6cf0-delete_volume" released by "delete_volume" :: held 2.226s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:53:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-fb3d2048-07b7-46e9-9d18-7d92d01c01fe req-c423617f-430c-416b-a308-7d9421ad00d3 tempest-TaggedAttachmentsTest-115675560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:53:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-fb3d2048-07b7-46e9-9d18-7d92d01c01fe req-c423617f-430c-416b-a308-7d9421ad00d3 tempest-TaggedAttachmentsTest-115675560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:53:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-fb3d2048-07b7-46e9-9d18-7d92d01c01fe req-c423617f-430c-416b-a308-7d9421ad00d3 tempest-TaggedAttachmentsTest-115675560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:53:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-fb3d2048-07b7-46e9-9d18-7d92d01c01fe req-c423617f-430c-416b-a308-7d9421ad00d3 tempest-TaggedAttachmentsTest-115675560 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d', 'name': 'volume-a4bafda3-f09f-4fe8-a164-fd84e5eb5003', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1cb9b733-234e-40ec-b463-83ad1fa6302b', 'enforce_multipath': True} {{(pid=86366) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 11:53:21 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-fb3d2048-07b7-46e9-9d18-7d92d01c01fe req-c423617f-430c-416b-a308-7d9421ad00d3 tempest-TaggedAttachmentsTest-115675560 None] attachment_update completed successfully. Sep 21 11:53:24 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-a67c9300-623a-44c2-b2a7-5b5db8653a6e req-d2f7648f-3055-416a-969d-342c0c802ea8 tempest-TaggedAttachmentsTest-115675560 None] Terminate volume connection completed successfully. Sep 21 11:53:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-a67c9300-623a-44c2-b2a7-5b5db8653a6e req-d2f7648f-3055-416a-969d-342c0c802ea8 tempest-TaggedAttachmentsTest-115675560 None] Deleting attachment 1cb9b733-234e-40ec-b463-83ad1fa6302b. {{(pid=86366) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 11:53:31 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=41,cinder:UPDATE=57,cinder:DELETE=5,cinder:INSERT=9 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:53:31 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=52,cinder:UPDATE=49,cinder:INSERT=13,cinder:DELETE=5 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:53:31 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-c6687509-085e-4847-8ec3-45d81eae350e tempest-GroupSnapshotsV319Test-621634398 None] Group tempest-GroupSnapshotsV319Test-Group-1433814310: creating Sep 21 11:53:31 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-c6687509-085e-4847-8ec3-45d81eae350e tempest-GroupSnapshotsV319Test-621634398 None] Group tempest-GroupSnapshotsV319Test-Group-1433814310: created successfully Sep 21 11:53:31 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-c6687509-085e-4847-8ec3-45d81eae350e tempest-GroupSnapshotsV319Test-621634398 None] Create group completed successfully. Sep 21 11:53:33 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:53:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Flow 'volume_create_manager' (1e7e6b54-f4a1-487c-aa7e-502aa3825468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:53:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a23c9459-e9a1-468e-94fe-0b8bd71cb5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:53:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a23c9459-e9a1-468e-94fe-0b8bd71cb5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-884876196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e49bfdd5-49bf-49f4-9b7f-6df793834947,host='devstack@QuobyteHD#QuobyteHD',id=63331736-61e7-496f-92a7-04b3dcf95f9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9168c84f0cd4a26b737e5666c915d30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:53:33Z,use_quota=True,user_id='109556e7e8304337be7b41ba56551802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8a8db70-5b09-4768-9d23-3019507f48a5),volume_type_id=d8a8db70-5b09-4768-9d23-3019507f48a5)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:53:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8787dff5-2030-48ad-90cb-965a3db8c814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:53:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8787dff5-2030-48ad-90cb-965a3db8c814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:53:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb818ec4-c499-40f5-9620-9d46f6af1342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:53:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb818ec4-c499-40f5-9620-9d46f6af1342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63331736-61e7-496f-92a7-04b3dcf95f9c', 'volume_name': 'volume-63331736-61e7-496f-92a7-04b3dcf95f9c', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:53:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43178d95-ad42-4bff-93c2-c03882726940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:53:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43178d95-ad42-4bff-93c2-c03882726940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:53:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bb9e69a-dbab-4062-9231-3d71332aa394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:53:33 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Volume 63331736-61e7-496f-92a7-04b3dcf95f9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63331736-61e7-496f-92a7-04b3dcf95f9c', 'volume_size': 1} Sep 21 11:53:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:53:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:53:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e49bfdd5-49bf-49f4-9b7f-6df793834947,created_at=2026-09-21T09:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-884876196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e49bfdd5-49bf-49f4-9b7f-6df793834947,host='devstack@QuobyteHD#QuobyteHD',id=63331736-61e7-496f-92a7-04b3dcf95f9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9168c84f0cd4a26b737e5666c915d30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:53:33Z,use_quota=True,user_id='109556e7e8304337be7b41ba56551802',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8a8db70-5b09-4768-9d23-3019507f48a5),volume_type_id=d8a8db70-5b09-4768-9d23-3019507f48a5)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:53:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Creating volume 63331736-61e7-496f-92a7-04b3dcf95f9c {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:53:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:53:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:53:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:53:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:53:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:53:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:53:33 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:53:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:33 devstack sudo[89626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c 1073741824 Sep 21 11:53:33 devstack sudo[89626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:33 devstack sudo[89626]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c 1073741824" returned: 0 in 0.565s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:34 devstack sudo[89633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c Sep 21 11:53:34 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:34 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c" returned: 0 in 0.322s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:34 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:53:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:53:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bb9e69a-dbab-4062-9231-3d71332aa394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63331736-61e7-496f-92a7-04b3dcf95f9c', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:53:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ca2d18-2347-4de2-9311-b3a614bc7123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:53:34 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Volume volume-63331736-61e7-496f-92a7-04b3dcf95f9c (63331736-61e7-496f-92a7-04b3dcf95f9c): created successfully Sep 21 11:53:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ca2d18-2347-4de2-9311-b3a614bc7123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:53:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Flow 'volume_create_manager' (1e7e6b54-f4a1-487c-aa7e-502aa3825468) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:53:34 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-9ef7f001-e4ff-4d63-98ea-8b128d26b7b1 tempest-GroupSnapshotsV319Test-621634398 None] Created volume successfully. Sep 21 11:53:36 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-471d5f8e-65df-435a-8b96-5825705abfcc tempest-GroupSnapshotsV319Test-621634398 None] GroupSnapshot bed37a52-aec2-4878-af03-03708ece7ef3: creating. Sep 21 11:53:36 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-471d5f8e-65df-435a-8b96-5825705abfcc tempest-GroupSnapshotsV319Test-621634398 None] Group snapshot bed37a52-aec2-4878-af03-03708ece7ef3: creating. {{(pid=86366) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 21 11:53:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-471d5f8e-65df-435a-8b96-5825705abfcc tempest-GroupSnapshotsV319Test-621634398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:53:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-471d5f8e-65df-435a-8b96-5825705abfcc tempest-GroupSnapshotsV319Test-621634398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:53:36 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-471d5f8e-65df-435a-8b96-5825705abfcc tempest-GroupSnapshotsV319Test-621634398 None] Creating offline snapshot 501bd26b-4519-4dc2-b25a-769b4a2dcb2f of volume 63331736-61e7-496f-92a7-04b3dcf95f9c {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 11:53:36 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[8944effc-8d39-4b21-82f4-d0a440a9002e]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:53:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-471d5f8e-65df-435a-8b96-5825705abfcc tempest-GroupSnapshotsV319Test-621634398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:36 devstack sudo[89639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c Sep 21 11:53:36 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:36 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-471d5f8e-65df-435a-8b96-5825705abfcc tempest-GroupSnapshotsV319Test-621634398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c" returned: 0 in 0.588s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-471d5f8e-65df-435a-8b96-5825705abfcc tempest-GroupSnapshotsV319Test-621634398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c.501bd26b-4519-4dc2-b25a-769b4a2dcb2f 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:36 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c.501bd26b-4519-4dc2-b25a-769b4a2dcb2f 1G Sep 21 11:53:36 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:36 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b6267858-2134-4d78-969d-db807c9aac94 tempest-TaggedAttachmentsTest-115675560 None] Acquiring lock "cinder-a4bafda3-f09f-4fe8-a164-fd84e5eb5003-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:53:36 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b6267858-2134-4d78-969d-db807c9aac94 tempest-TaggedAttachmentsTest-115675560 None] Lock "cinder-a4bafda3-f09f-4fe8-a164-fd84e5eb5003-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:53:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b6267858-2134-4d78-969d-db807c9aac94 tempest-TaggedAttachmentsTest-115675560 None] Acquiring lock "cinder-quobyte-a4bafda3-f09f-4fe8-a164-fd84e5eb5003" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:53:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b6267858-2134-4d78-969d-db807c9aac94 tempest-TaggedAttachmentsTest-115675560 None] Lock "cinder-quobyte-a4bafda3-f09f-4fe8-a164-fd84e5eb5003" acquired by "delete_volume" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:53:37 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1d30c8-5e76-4929-a025-45dffc6c4d62]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:53:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b6267858-2134-4d78-969d-db807c9aac94 tempest-TaggedAttachmentsTest-115675560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4bafda3-f09f-4fe8-a164-fd84e5eb5003 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:37 devstack sudo[89648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4bafda3-f09f-4fe8-a164-fd84e5eb5003 Sep 21 11:53:37 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:37 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-471d5f8e-65df-435a-8b96-5825705abfcc tempest-GroupSnapshotsV319Test-621634398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c.501bd26b-4519-4dc2-b25a-769b4a2dcb2f 1G" returned: 0 in 0.633s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-471d5f8e-65df-435a-8b96-5825705abfcc tempest-GroupSnapshotsV319Test-621634398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63331736-61e7-496f-92a7-04b3dcf95f9c -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c.501bd26b-4519-4dc2-b25a-769b4a2dcb2f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:37 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63331736-61e7-496f-92a7-04b3dcf95f9c -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c.501bd26b-4519-4dc2-b25a-769b4a2dcb2f Sep 21 11:53:37 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:37 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b6267858-2134-4d78-969d-db807c9aac94 tempest-TaggedAttachmentsTest-115675560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4bafda3-f09f-4fe8-a164-fd84e5eb5003" returned: 0 in 0.507s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b6267858-2134-4d78-969d-db807c9aac94 tempest-TaggedAttachmentsTest-115675560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4bafda3-f09f-4fe8-a164-fd84e5eb5003 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:37 devstack sudo[89659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4bafda3-f09f-4fe8-a164-fd84e5eb5003 Sep 21 11:53:37 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:38 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-471d5f8e-65df-435a-8b96-5825705abfcc tempest-GroupSnapshotsV319Test-621634398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63331736-61e7-496f-92a7-04b3dcf95f9c -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c.501bd26b-4519-4dc2-b25a-769b4a2dcb2f" returned: 0 in 0.494s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:38 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-471d5f8e-65df-435a-8b96-5825705abfcc tempest-GroupSnapshotsV319Test-621634398 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c.501bd26b-4519-4dc2-b25a-769b4a2dcb2f is being set with open permissions: ugo+rw: NotImplementedError Sep 21 11:53:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-471d5f8e-65df-435a-8b96-5825705abfcc tempest-GroupSnapshotsV319Test-621634398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c.501bd26b-4519-4dc2-b25a-769b4a2dcb2f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:38 devstack sudo[89666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c.501bd26b-4519-4dc2-b25a-769b4a2dcb2f Sep 21 11:53:38 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:38 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b6267858-2134-4d78-969d-db807c9aac94 tempest-TaggedAttachmentsTest-115675560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4bafda3-f09f-4fe8-a164-fd84e5eb5003" returned: 0 in 0.442s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b6267858-2134-4d78-969d-db807c9aac94 tempest-TaggedAttachmentsTest-115675560 None] Lock "cinder-quobyte-a4bafda3-f09f-4fe8-a164-fd84e5eb5003" released by "delete_volume" :: held 1.029s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:53:38 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-b6267858-2134-4d78-969d-db807c9aac94 tempest-TaggedAttachmentsTest-115675560 None] Created reservations ['54e1f108-c98a-4a65-8620-e7fccafe4765', '51e7964d-76ef-40d0-83ea-ef45771d8843', '33bb0f13-be36-489a-bef2-86f6474c1fc5', 'a010bed0-04de-4975-91eb-7c299ba4a39a'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:53:38 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-b9fe2d5f-4f11-4292-bbeb-aa6d060a1140 req-5f38fd3c-c054-43f5-bd43-890872bc8012 tempest-AttachVolumeNegativeTest-1753132709 None] Terminate volume connection completed successfully. Sep 21 11:53:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-b9fe2d5f-4f11-4292-bbeb-aa6d060a1140 req-5f38fd3c-c054-43f5-bd43-890872bc8012 tempest-AttachVolumeNegativeTest-1753132709 None] Deleting attachment f7db9529-bbd0-4e3f-ae95-8fc4298cc9e3. {{(pid=86366) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 11:53:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b6267858-2134-4d78-969d-db807c9aac94 tempest-TaggedAttachmentsTest-115675560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:53:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b6267858-2134-4d78-969d-db807c9aac94 tempest-TaggedAttachmentsTest-115675560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:53:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b6267858-2134-4d78-969d-db807c9aac94 tempest-TaggedAttachmentsTest-115675560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:53:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b6267858-2134-4d78-969d-db807c9aac94 tempest-TaggedAttachmentsTest-115675560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:53:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b6267858-2134-4d78-969d-db807c9aac94 tempest-TaggedAttachmentsTest-115675560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:53:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b6267858-2134-4d78-969d-db807c9aac94 tempest-TaggedAttachmentsTest-115675560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:38 devstack sudo[89673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:53:38 devstack sudo[89673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:38 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-471d5f8e-65df-435a-8b96-5825705abfcc tempest-GroupSnapshotsV319Test-621634398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c.501bd26b-4519-4dc2-b25a-769b4a2dcb2f" returned: 0 in 0.340s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-471d5f8e-65df-435a-8b96-5825705abfcc tempest-GroupSnapshotsV319Test-621634398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:38 devstack sudo[89675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c.info Sep 21 11:53:38 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:38 devstack sudo[89673]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b6267858-2134-4d78-969d-db807c9aac94 tempest-TaggedAttachmentsTest-115675560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.306s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:38 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-b6267858-2134-4d78-969d-db807c9aac94 tempest-TaggedAttachmentsTest-115675560 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:53:38 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-b6267858-2134-4d78-969d-db807c9aac94 tempest-TaggedAttachmentsTest-115675560 None] Deleted volume successfully. Sep 21 11:53:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b6267858-2134-4d78-969d-db807c9aac94 tempest-TaggedAttachmentsTest-115675560 None] Lock "cinder-a4bafda3-f09f-4fe8-a164-fd84e5eb5003-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:53:38 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-471d5f8e-65df-435a-8b96-5825705abfcc tempest-GroupSnapshotsV319Test-621634398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c.info" returned: 0 in 0.298s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:38 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-471d5f8e-65df-435a-8b96-5825705abfcc tempest-GroupSnapshotsV319Test-621634398 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 21 11:53:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-471d5f8e-65df-435a-8b96-5825705abfcc tempest-GroupSnapshotsV319Test-621634398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:38 devstack sudo[89679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c.info Sep 21 11:53:38 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:38 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-471d5f8e-65df-435a-8b96-5825705abfcc tempest-GroupSnapshotsV319Test-621634398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c.info" returned: 0 in 0.274s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-471d5f8e-65df-435a-8b96-5825705abfcc tempest-GroupSnapshotsV319Test-621634398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.735s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:53:39 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-471d5f8e-65df-435a-8b96-5825705abfcc tempest-GroupSnapshotsV319Test-621634398 None] group_snapshot bed37a52-aec2-4878-af03-03708ece7ef3: created successfully Sep 21 11:53:40 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-272e08db-8d2f-4cb7-a029-4b6bb71cc9d0 tempest-GroupSnapshotsV319Test-621634398 None] group_snapshot bed37a52-aec2-4878-af03-03708ece7ef3: deleting Sep 21 11:53:40 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-272e08db-8d2f-4cb7-a029-4b6bb71cc9d0 tempest-GroupSnapshotsV319Test-621634398 None] group_snapshot bed37a52-aec2-4878-af03-03708ece7ef3: deleting {{(pid=86366) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 21 11:53:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-272e08db-8d2f-4cb7-a029-4b6bb71cc9d0 tempest-GroupSnapshotsV319Test-621634398 None] Acquiring lock "cinder-quobyte-63331736-61e7-496f-92a7-04b3dcf95f9c" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:53:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-272e08db-8d2f-4cb7-a029-4b6bb71cc9d0 tempest-GroupSnapshotsV319Test-621634398 None] Lock "cinder-quobyte-63331736-61e7-496f-92a7-04b3dcf95f9c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:53:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-272e08db-8d2f-4cb7-a029-4b6bb71cc9d0 tempest-GroupSnapshotsV319Test-621634398 None] Acquiring lock "cinder-quobyte-501bd26b-4519-4dc2-b25a-769b4a2dcb2f" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:53:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-272e08db-8d2f-4cb7-a029-4b6bb71cc9d0 tempest-GroupSnapshotsV319Test-621634398 None] Lock "cinder-quobyte-501bd26b-4519-4dc2-b25a-769b4a2dcb2f" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:53:40 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-272e08db-8d2f-4cb7-a029-4b6bb71cc9d0 tempest-GroupSnapshotsV319Test-621634398 None] Deleting offline snapshot 501bd26b-4519-4dc2-b25a-769b4a2dcb2f of volume 63331736-61e7-496f-92a7-04b3dcf95f9c {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 11:53:40 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-272e08db-8d2f-4cb7-a029-4b6bb71cc9d0 tempest-GroupSnapshotsV319Test-621634398 None] snapshot_file for this snap is: volume-63331736-61e7-496f-92a7-04b3dcf95f9c.501bd26b-4519-4dc2-b25a-769b4a2dcb2f {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 11:53:40 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc49812d-e8bd-4332-9bcc-d964ff06f424]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:53:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-272e08db-8d2f-4cb7-a029-4b6bb71cc9d0 tempest-GroupSnapshotsV319Test-621634398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c.501bd26b-4519-4dc2-b25a-769b4a2dcb2f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:40 devstack sudo[89704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c.501bd26b-4519-4dc2-b25a-769b4a2dcb2f Sep 21 11:53:40 devstack sudo[89704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:40 devstack sudo[89704]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-272e08db-8d2f-4cb7-a029-4b6bb71cc9d0 tempest-GroupSnapshotsV319Test-621634398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c.501bd26b-4519-4dc2-b25a-769b4a2dcb2f" returned: 0 in 0.491s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:40 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-272e08db-8d2f-4cb7-a029-4b6bb71cc9d0 tempest-GroupSnapshotsV319Test-621634398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63331736-61e7-496f-92a7-04b3dcf95f9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 11:53:41 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c88904-be69-4584-9352-8dce30df071c]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:53:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-272e08db-8d2f-4cb7-a029-4b6bb71cc9d0 tempest-GroupSnapshotsV319Test-621634398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:41 devstack sudo[89711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c Sep 21 11:53:41 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:41 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-272e08db-8d2f-4cb7-a029-4b6bb71cc9d0 tempest-GroupSnapshotsV319Test-621634398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c" returned: 0 in 0.450s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-272e08db-8d2f-4cb7-a029-4b6bb71cc9d0 tempest-GroupSnapshotsV319Test-621634398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c.501bd26b-4519-4dc2-b25a-769b4a2dcb2f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:41 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c.501bd26b-4519-4dc2-b25a-769b4a2dcb2f Sep 21 11:53:41 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:41 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-272e08db-8d2f-4cb7-a029-4b6bb71cc9d0 tempest-GroupSnapshotsV319Test-621634398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c.501bd26b-4519-4dc2-b25a-769b4a2dcb2f" returned: 0 in 0.512s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-272e08db-8d2f-4cb7-a029-4b6bb71cc9d0 tempest-GroupSnapshotsV319Test-621634398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c.501bd26b-4519-4dc2-b25a-769b4a2dcb2f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:42 devstack sudo[89759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c.501bd26b-4519-4dc2-b25a-769b4a2dcb2f Sep 21 11:53:42 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:42 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-272e08db-8d2f-4cb7-a029-4b6bb71cc9d0 tempest-GroupSnapshotsV319Test-621634398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c.501bd26b-4519-4dc2-b25a-769b4a2dcb2f" returned: 0 in 0.362s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-272e08db-8d2f-4cb7-a029-4b6bb71cc9d0 tempest-GroupSnapshotsV319Test-621634398 None] Lock "cinder-quobyte-501bd26b-4519-4dc2-b25a-769b4a2dcb2f" released by "_delete_snapshot" :: held 2.031s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:53:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-272e08db-8d2f-4cb7-a029-4b6bb71cc9d0 tempest-GroupSnapshotsV319Test-621634398 None] Lock "cinder-quobyte-63331736-61e7-496f-92a7-04b3dcf95f9c" released by "delete_snapshot" :: held 2.075s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:53:42 devstack cinder-volume[86366]: WARNING cinder.quota [None req-272e08db-8d2f-4cb7-a029-4b6bb71cc9d0 tempest-GroupSnapshotsV319Test-621634398 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1805558022 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1805558022, it is now deprecated. Please use the default quota class for default quota. Sep 21 11:53:42 devstack cinder-volume[86366]: WARNING cinder.quota [None req-272e08db-8d2f-4cb7-a029-4b6bb71cc9d0 tempest-GroupSnapshotsV319Test-621634398 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1805558022 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1805558022, it is now deprecated. Please use the default quota class for default quota. Sep 21 11:53:42 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-272e08db-8d2f-4cb7-a029-4b6bb71cc9d0 tempest-GroupSnapshotsV319Test-621634398 None] Created reservations ['bfabc189-00f6-466b-897d-2c614730c70c', '06fa7b24-5326-4857-ae4c-e073bbe196b8', '9333b710-2d91-4b04-951c-4909f7731d42', '41caa5f7-545f-4c64-89a5-9c7685bb25fd'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:53:42 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-272e08db-8d2f-4cb7-a029-4b6bb71cc9d0 tempest-GroupSnapshotsV319Test-621634398 None] group_snapshot bed37a52-aec2-4878-af03-03708ece7ef3: deleted successfully Sep 21 11:53:43 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c56024f8-fee6-487b-9633-caa3450c997a tempest-GroupSnapshotsV319Test-621634398 None] Acquiring lock "cinder-quobyte-63331736-61e7-496f-92a7-04b3dcf95f9c" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:53:43 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c56024f8-fee6-487b-9633-caa3450c997a tempest-GroupSnapshotsV319Test-621634398 None] Lock "cinder-quobyte-63331736-61e7-496f-92a7-04b3dcf95f9c" acquired by "delete_volume" :: waited 0.025s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:53:43 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0fb3ee-e14b-44f1-9dd9-b1c42fcb89cd]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:53:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c56024f8-fee6-487b-9633-caa3450c997a tempest-GroupSnapshotsV319Test-621634398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:43 devstack sudo[89771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c Sep 21 11:53:43 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:43 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c56024f8-fee6-487b-9633-caa3450c997a tempest-GroupSnapshotsV319Test-621634398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c" returned: 0 in 0.544s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c56024f8-fee6-487b-9633-caa3450c997a tempest-GroupSnapshotsV319Test-621634398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:43 devstack sudo[89785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c Sep 21 11:53:43 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-cd0b6258-c7d1-45d6-8758-988379094a2a req-f6fb71a7-2479-4c2f-aabd-02861eb81bb1 tempest-ServerActionsTestOtherA-1757437079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:53:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-cd0b6258-c7d1-45d6-8758-988379094a2a req-f6fb71a7-2479-4c2f-aabd-02861eb81bb1 tempest-ServerActionsTestOtherA-1757437079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:53:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-cd0b6258-c7d1-45d6-8758-988379094a2a req-f6fb71a7-2479-4c2f-aabd-02861eb81bb1 tempest-ServerActionsTestOtherA-1757437079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:53:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-cd0b6258-c7d1-45d6-8758-988379094a2a req-f6fb71a7-2479-4c2f-aabd-02861eb81bb1 tempest-ServerActionsTestOtherA-1757437079 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d', 'name': 'volume-c1025f83-1946-4609-84ff-0ceb47818c4b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5ddd7cbe-6014-48c9-85f3-c6771880df1c', 'enforce_multipath': True} {{(pid=86366) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 11:53:44 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-cd0b6258-c7d1-45d6-8758-988379094a2a req-f6fb71a7-2479-4c2f-aabd-02861eb81bb1 tempest-ServerActionsTestOtherA-1757437079 None] attachment_update completed successfully. Sep 21 11:53:44 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c56024f8-fee6-487b-9633-caa3450c997a tempest-GroupSnapshotsV319Test-621634398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-63331736-61e7-496f-92a7-04b3dcf95f9c" returned: 0 in 0.333s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:44 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c56024f8-fee6-487b-9633-caa3450c997a tempest-GroupSnapshotsV319Test-621634398 None] Lock "cinder-quobyte-63331736-61e7-496f-92a7-04b3dcf95f9c" released by "delete_volume" :: held 0.972s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:53:44 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-c56024f8-fee6-487b-9633-caa3450c997a tempest-GroupSnapshotsV319Test-621634398 None] Created reservations ['eb268f22-69e1-44c9-a72e-b26fb604e2b5'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:53:44 devstack cinder-volume[86366]: WARNING cinder.quota [None req-c56024f8-fee6-487b-9633-caa3450c997a tempest-GroupSnapshotsV319Test-621634398 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1805558022 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1805558022, it is now deprecated. Please use the default quota class for default quota. Sep 21 11:53:44 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-c56024f8-fee6-487b-9633-caa3450c997a tempest-GroupSnapshotsV319Test-621634398 None] Created reservations ['97a85217-6e1e-4bb2-b914-4fdba6321940', 'fe80529d-854d-4c76-8e8c-2aeab739aac6', '7d5200e3-c013-459a-928f-819ca5ea4a08', 'b55e0a33-98bd-494a-9302-da81ccf9caa3'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:53:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c56024f8-fee6-487b-9633-caa3450c997a tempest-GroupSnapshotsV319Test-621634398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:53:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c56024f8-fee6-487b-9633-caa3450c997a tempest-GroupSnapshotsV319Test-621634398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:53:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c56024f8-fee6-487b-9633-caa3450c997a tempest-GroupSnapshotsV319Test-621634398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:53:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c56024f8-fee6-487b-9633-caa3450c997a tempest-GroupSnapshotsV319Test-621634398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:53:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c56024f8-fee6-487b-9633-caa3450c997a tempest-GroupSnapshotsV319Test-621634398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:53:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c56024f8-fee6-487b-9633-caa3450c997a tempest-GroupSnapshotsV319Test-621634398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:44 devstack sudo[90020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:53:44 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:45 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c56024f8-fee6-487b-9633-caa3450c997a tempest-GroupSnapshotsV319Test-621634398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.448s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:45 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-c56024f8-fee6-487b-9633-caa3450c997a tempest-GroupSnapshotsV319Test-621634398 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:53:45 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-c56024f8-fee6-487b-9633-caa3450c997a tempest-GroupSnapshotsV319Test-621634398 None] Delete group completed successfully. Sep 21 11:53:48 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-a0ae8af6-d7b0-4562-b596-50c788fa6f68 req-536133c2-e101-4d62-b507-4ee06e16676c tempest-ServerActionsTestOtherA-1757437079 None] Terminate volume connection completed successfully. Sep 21 11:53:48 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-a0ae8af6-d7b0-4562-b596-50c788fa6f68 req-536133c2-e101-4d62-b507-4ee06e16676c tempest-ServerActionsTestOtherA-1757437079 None] Deleting attachment 5ddd7cbe-6014-48c9-85f3-c6771880df1c. {{(pid=86366) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 11:53:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-a0ae8af6-d7b0-4562-b596-50c788fa6f68 req-598f7814-237b-48f7-9cde-a0aa7c0117c4 tempest-ServerActionsTestOtherA-1757437079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:53:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-a0ae8af6-d7b0-4562-b596-50c788fa6f68 req-598f7814-237b-48f7-9cde-a0aa7c0117c4 tempest-ServerActionsTestOtherA-1757437079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:53:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-a0ae8af6-d7b0-4562-b596-50c788fa6f68 req-598f7814-237b-48f7-9cde-a0aa7c0117c4 tempest-ServerActionsTestOtherA-1757437079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:53:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-a0ae8af6-d7b0-4562-b596-50c788fa6f68 req-598f7814-237b-48f7-9cde-a0aa7c0117c4 tempest-ServerActionsTestOtherA-1757437079 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d', 'name': 'volume-c1025f83-1946-4609-84ff-0ceb47818c4b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c9e84a1-551e-4016-8377-f3cc650fb5e1', 'enforce_multipath': True} {{(pid=86366) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 11:53:49 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-a0ae8af6-d7b0-4562-b596-50c788fa6f68 req-598f7814-237b-48f7-9cde-a0aa7c0117c4 tempest-ServerActionsTestOtherA-1757437079 None] attachment_update completed successfully. Sep 21 11:53:58 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:53:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Flow 'volume_create_manager' (826e7937-606b-4b59-98ab-acebefd7c30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:53:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d6e488-996d-4ee8-ac19-1ef9632c5f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:53:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d6e488-996d-4ee8-ac19-1ef9632c5f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1934054972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b80a8edf-9d83-49ca-85b5-76efb81a5a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94afd1eafb1d4068a676380eae43de24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:53:58Z,use_quota=True,user_id='2fa3812e83964055be987e12af824c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(259db271-fa6f-4497-9744-b74142d93375),volume_type_id=259db271-fa6f-4497-9744-b74142d93375)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:53:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b397cf2e-23d4-43b5-ba8b-0b0eb7be788e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:53:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b397cf2e-23d4-43b5-ba8b-0b0eb7be788e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:53:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0da0f14-750b-479e-90ca-ff435fb793cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:53:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0da0f14-750b-479e-90ca-ff435fb793cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b80a8edf-9d83-49ca-85b5-76efb81a5a62', 'volume_name': 'volume-b80a8edf-9d83-49ca-85b5-76efb81a5a62', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:53:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (328a9951-9f7d-4f0d-b06d-c60a78c2069c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:53:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (328a9951-9f7d-4f0d-b06d-c60a78c2069c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:53:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b50ba0f-57f5-4c8b-9d00-a6f5ba7f5408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:53:58 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Volume b80a8edf-9d83-49ca-85b5-76efb81a5a62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b80a8edf-9d83-49ca-85b5-76efb81a5a62', 'volume_size': 1} Sep 21 11:53:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:53:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:53:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1934054972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b80a8edf-9d83-49ca-85b5-76efb81a5a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94afd1eafb1d4068a676380eae43de24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:53:58Z,use_quota=True,user_id='2fa3812e83964055be987e12af824c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(259db271-fa6f-4497-9744-b74142d93375),volume_type_id=259db271-fa6f-4497-9744-b74142d93375)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:53:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Creating volume b80a8edf-9d83-49ca-85b5-76efb81a5a62 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:53:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:53:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:53:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:53:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:53:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:53:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:53:58 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:53:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b80a8edf-9d83-49ca-85b5-76efb81a5a62 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:58 devstack sudo[90799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b80a8edf-9d83-49ca-85b5-76efb81a5a62 1073741824 Sep 21 11:53:58 devstack sudo[90799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:59 devstack sudo[90799]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b80a8edf-9d83-49ca-85b5-76efb81a5a62 1073741824" returned: 0 in 0.710s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b80a8edf-9d83-49ca-85b5-76efb81a5a62 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:53:59 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b80a8edf-9d83-49ca-85b5-76efb81a5a62 Sep 21 11:53:59 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:53:59 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Sep 21 11:53:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b80a8edf-9d83-49ca-85b5-76efb81a5a62" returned: 0 in 0.638s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:53:59 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:53:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:54:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b50ba0f-57f5-4c8b-9d00-a6f5ba7f5408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b80a8edf-9d83-49ca-85b5-76efb81a5a62', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:54:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef98e737-5ffd-4315-a04b-f389e52b2c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:54:00 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Volume volume-b80a8edf-9d83-49ca-85b5-76efb81a5a62 (b80a8edf-9d83-49ca-85b5-76efb81a5a62): created successfully Sep 21 11:54:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef98e737-5ffd-4315-a04b-f389e52b2c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:54:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Flow 'volume_create_manager' (826e7937-606b-4b59-98ab-acebefd7c30b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:54:00 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-bcf1cdb5-75e4-49b9-96ff-ec406c25d4a3 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Created volume successfully. Sep 21 11:54:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-548cfe2c-46cd-4253-b1c3-707afa08ea23 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:54:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-548cfe2c-46cd-4253-b1c3-707afa08ea23 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:54:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-548cfe2c-46cd-4253-b1c3-707afa08ea23 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:54:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-548cfe2c-46cd-4253-b1c3-707afa08ea23 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:54:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-548cfe2c-46cd-4253-b1c3-707afa08ea23 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:54:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-548cfe2c-46cd-4253-b1c3-707afa08ea23 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:54:01 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:54:01 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:54:02 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Sep 21 11:54:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-548cfe2c-46cd-4253-b1c3-707afa08ea23 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.790s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:54:02 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-548cfe2c-46cd-4253-b1c3-707afa08ea23 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:54:02 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-548cfe2c-46cd-4253-b1c3-707afa08ea23 tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Retype volume completed successfully. Sep 21 11:54:03 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e7966a76-d933-4f6c-bf19-c1a5c978f9dd tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Acquiring lock "cinder-b80a8edf-9d83-49ca-85b5-76efb81a5a62-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:54:03 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e7966a76-d933-4f6c-bf19-c1a5c978f9dd tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Lock "cinder-b80a8edf-9d83-49ca-85b5-76efb81a5a62-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:54:03 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e7966a76-d933-4f6c-bf19-c1a5c978f9dd tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Acquiring lock "cinder-quobyte-b80a8edf-9d83-49ca-85b5-76efb81a5a62" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:54:03 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e7966a76-d933-4f6c-bf19-c1a5c978f9dd tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Lock "cinder-quobyte-b80a8edf-9d83-49ca-85b5-76efb81a5a62" acquired by "delete_volume" :: waited 0.028s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:54:03 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a54271-5a5b-4fbe-bd31-c249903d82e0]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:54:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e7966a76-d933-4f6c-bf19-c1a5c978f9dd tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b80a8edf-9d83-49ca-85b5-76efb81a5a62 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:54:03 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 11:54:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:54:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:54:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:54:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:54:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:54:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:54:03 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:54:03 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:54:03 devstack sudo[90884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b80a8edf-9d83-49ca-85b5-76efb81a5a62 Sep 21 11:54:03 devstack sudo[90884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:54:04 devstack sudo[90884]: pam_unix(sudo:session): session closed for user root Sep 21 11:54:04 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Sep 21 11:54:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e7966a76-d933-4f6c-bf19-c1a5c978f9dd tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b80a8edf-9d83-49ca-85b5-76efb81a5a62" returned: 0 in 0.625s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:54:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e7966a76-d933-4f6c-bf19-c1a5c978f9dd tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b80a8edf-9d83-49ca-85b5-76efb81a5a62 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:54:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.565s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:54:04 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:54:04 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 11:54:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread count: 8 {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 11:54:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread info: [<_MainThread(MainThread, started 132841976594560)>, , , , , , , ] {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 11:54:04 devstack sudo[90893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b80a8edf-9d83-49ca-85b5-76efb81a5a62 Sep 21 11:54:04 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:54:04 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root Sep 21 11:54:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e7966a76-d933-4f6c-bf19-c1a5c978f9dd tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b80a8edf-9d83-49ca-85b5-76efb81a5a62" returned: 0 in 0.444s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:54:04 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e7966a76-d933-4f6c-bf19-c1a5c978f9dd tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Lock "cinder-quobyte-b80a8edf-9d83-49ca-85b5-76efb81a5a62" released by "delete_volume" :: held 1.152s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:54:04 devstack cinder-volume[86366]: WARNING cinder.quota [None req-e7966a76-d933-4f6c-bf19-c1a5c978f9dd tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 21 11:54:04 devstack cinder-volume[86366]: WARNING cinder.quota [None req-e7966a76-d933-4f6c-bf19-c1a5c978f9dd tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 21 11:54:04 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-e7966a76-d933-4f6c-bf19-c1a5c978f9dd tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Created reservations ['75af4d9f-344a-4493-b6b3-80576b02b422', 'd95a3801-2236-40f7-bd5a-6ce66f6cc8b6', 'e2aae256-eac3-4e06-84cf-51292207d237', '3e5d42ab-f1d1-4597-b97f-1a0a2db11d81'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:54:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e7966a76-d933-4f6c-bf19-c1a5c978f9dd tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:54:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e7966a76-d933-4f6c-bf19-c1a5c978f9dd tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:54:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e7966a76-d933-4f6c-bf19-c1a5c978f9dd tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:54:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e7966a76-d933-4f6c-bf19-c1a5c978f9dd tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:54:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e7966a76-d933-4f6c-bf19-c1a5c978f9dd tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:54:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e7966a76-d933-4f6c-bf19-c1a5c978f9dd tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:54:04 devstack sudo[90896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:54:04 devstack sudo[90896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:54:05 devstack sudo[90896]: pam_unix(sudo:session): session closed for user root Sep 21 11:54:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e7966a76-d933-4f6c-bf19-c1a5c978f9dd tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.395s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:54:05 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-e7966a76-d933-4f6c-bf19-c1a5c978f9dd tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:54:05 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-e7966a76-d933-4f6c-bf19-c1a5c978f9dd tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Deleted volume successfully. Sep 21 11:54:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e7966a76-d933-4f6c-bf19-c1a5c978f9dd tempest-VolumeRetypeWithoutMigrationTest-1812449599 None] Lock "cinder-b80a8edf-9d83-49ca-85b5-76efb81a5a62-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:54:14 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:UPDATE=53,cinder:SELECT=54,cinder:DELETE=1,cinder:INSERT=8 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:54:15 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=63,cinder:UPDATE=47,cinder:INSERT=12,cinder:DELETE=3 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:54:19 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-02fd57f8-b6f8-4b52-8f99-50c4dae71773 req-1eb1c151-a929-425f-bf3e-5a8bbf285274 tempest-ServerActionsTestOtherA-1757437079 None] Terminate volume connection completed successfully. Sep 21 11:54:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-02fd57f8-b6f8-4b52-8f99-50c4dae71773 req-1eb1c151-a929-425f-bf3e-5a8bbf285274 tempest-ServerActionsTestOtherA-1757437079 None] Deleting attachment 8c9e84a1-551e-4016-8377-f3cc650fb5e1. {{(pid=86366) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 11:54:27 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:54:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Flow 'volume_create_manager' (28f7bdd0-1985-4b60-92dc-aac118e0d734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:54:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f354a6-386b-4335-ad45-cc1167206f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:54:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74f354a6-386b-4335-ad45-cc1167206f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-837260819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9de38c29-96ff-46d0-9931-8de67f9cc390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1724e5bb6794fc8bb9e4b1bca35d859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:54:28Z,use_quota=True,user_id='b2d2b228a41c439883ed60c78a440e07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:54:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3111524f-c06c-4c5b-9548-d145287ab0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:54:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3111524f-c06c-4c5b-9548-d145287ab0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:54:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e423c9-d948-4fe8-8fb9-4dbb2d5b7c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:54:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e423c9-d948-4fe8-8fb9-4dbb2d5b7c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9de38c29-96ff-46d0-9931-8de67f9cc390', 'volume_name': 'volume-9de38c29-96ff-46d0-9931-8de67f9cc390', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:54:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6aa5d3a-64b4-41dd-84ef-bc1c03b354f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:54:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6aa5d3a-64b4-41dd-84ef-bc1c03b354f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:54:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e20246-5f5d-44f6-9891-27c35e173855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:54:27 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Volume 9de38c29-96ff-46d0-9931-8de67f9cc390: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9de38c29-96ff-46d0-9931-8de67f9cc390', 'volume_size': 1} Sep 21 11:54:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:54:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:54:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-837260819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9de38c29-96ff-46d0-9931-8de67f9cc390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1724e5bb6794fc8bb9e4b1bca35d859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:54:28Z,use_quota=True,user_id='b2d2b228a41c439883ed60c78a440e07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:54:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Creating volume 9de38c29-96ff-46d0-9931-8de67f9cc390 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:54:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:54:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:54:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:54:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:54:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:54:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:54:27 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:54:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9de38c29-96ff-46d0-9931-8de67f9cc390 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:54:27 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9de38c29-96ff-46d0-9931-8de67f9cc390 1073741824 Sep 21 11:54:27 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:54:28 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:54:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Flow 'volume_create_manager' (080d24f6-a6c0-4d93-af18-3a5d3aaf504b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:54:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3dee935-3df0-4368-81cc-cf5bfb8fd155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:54:28 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Sep 21 11:54:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9de38c29-96ff-46d0-9931-8de67f9cc390 1073741824" returned: 0 in 0.717s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:54:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3dee935-3df0-4368-81cc-cf5bfb8fd155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-476090338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a866f85ad3194ff7854b228c3f0a750b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:54:28Z,use_quota=True,user_id='9eb47b243a624d2d98aef1b57aada116',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:54:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f154d6-3550-4e08-8115-ee7c99005250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:54:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f154d6-3550-4e08-8115-ee7c99005250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:54:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d278fdf-1d6a-425c-81ed-04fec91059cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:54:28 devstack cinder-volume[86366]: DEBUG cinder.image.glance [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Creating Keystone auth plugin from conf {{(pid=86366) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 21 11:54:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9de38c29-96ff-46d0-9931-8de67f9cc390 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:54:28 devstack sudo[91056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9de38c29-96ff-46d0-9931-8de67f9cc390 Sep 21 11:54:28 devstack sudo[91056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:54:28 devstack sudo[91056]: pam_unix(sudo:session): session closed for user root Sep 21 11:54:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9de38c29-96ff-46d0-9931-8de67f9cc390" returned: 0 in 0.340s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:54:28 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:54:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:54:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e20246-5f5d-44f6-9891-27c35e173855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9de38c29-96ff-46d0-9931-8de67f9cc390', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:54:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e00a48-c2a8-43f0-bb16-c811d260f33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:54:28 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Volume volume-9de38c29-96ff-46d0-9931-8de67f9cc390 (9de38c29-96ff-46d0-9931-8de67f9cc390): created successfully Sep 21 11:54:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e00a48-c2a8-43f0-bb16-c811d260f33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:54:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Flow 'volume_create_manager' (28f7bdd0-1985-4b60-92dc-aac118e0d734) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:54:29 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-d695ec63-a8e7-4208-bcb4-9791ce0a8cc4 tempest-AttachVolumeNegativeTest-1753132709 None] Created volume successfully. Sep 21 11:54:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d278fdf-1d6a-425c-81ed-04fec91059cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4', 'volume_name': 'volume-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4', 'volume_size': 1, 'image_id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6c23462c1d34d9a9d8fbc8d8872d421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'created_at': datetime.datetime(2026, 9, 21, 9, 44, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 9, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:54:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c51a22-9605-4bb3-81a7-33ae2e3f70e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:54:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c51a22-9605-4bb3-81a7-33ae2e3f70e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:54:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59989ca1-30d3-468d-aa63-a5999d73d782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:54:29 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Volume 9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4', 'volume_size': 1, 'image_id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6c23462c1d34d9a9d8fbc8d8872d421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'created_at': datetime.datetime(2026, 9, 21, 9, 44, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 9, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 21 11:54:29 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Trying to clone 9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4 from image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}]). {{(pid=86366) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 21 11:54:29 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_kobeve2rdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 21 11:54:29 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Image download 20.69 MB at 20.69 MB/s Sep 21 11:54:29 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[112eb76f-7c93-4241-b243-3f23321e21a6]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:54:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_kobeve2rdevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:54:29 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_kobeve2rdevstack@QuobyteHD Sep 21 11:54:29 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:54:30 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Sep 21 11:54:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_kobeve2rdevstack@QuobyteHD" returned: 0 in 0.727s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:54:30 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Temporary image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 is fetched for user 9eb47b243a624d2d98aef1b57aada116. {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 21 11:54:30 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcfb6dd-7a94-4ff0-b997-33137d3c38b7]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:54:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_kobeve2rdevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:54:30 devstack sudo[91128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_kobeve2rdevstack@QuobyteHD Sep 21 11:54:30 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:54:31 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root Sep 21 11:54:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_kobeve2rdevstack@QuobyteHD" returned: 0 in 0.845s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:54:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:54:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:54:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-476090338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a866f85ad3194ff7854b228c3f0a750b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:54:28Z,use_quota=True,user_id='9eb47b243a624d2d98aef1b57aada116',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:54:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Creating volume 9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:54:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:54:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:54:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:54:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:54:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:54:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:54:31 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:54:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:54:31 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4 1073741824 Sep 21 11:54:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-65e1fa05-96c6-46fc-8fb0-998ceaeeae39 req-1d0969c5-060c-41fe-86c4-2caebf119b79 tempest-AttachVolumeNegativeTest-1753132709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:54:31 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:54:32 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Sep 21 11:54:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4 1073741824" returned: 0 in 0.804s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:54:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:54:32 devstack sudo[91182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4 Sep 21 11:54:32 devstack sudo[91182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:54:32 devstack sudo[91182]: pam_unix(sudo:session): session closed for user root Sep 21 11:54:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4" returned: 0 in 0.502s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:54:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:54:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:54:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-65e1fa05-96c6-46fc-8fb0-998ceaeeae39 req-1d0969c5-060c-41fe-86c4-2caebf119b79 tempest-AttachVolumeNegativeTest-1753132709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.317s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:54:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-65e1fa05-96c6-46fc-8fb0-998ceaeeae39 req-1d0969c5-060c-41fe-86c4-2caebf119b79 tempest-AttachVolumeNegativeTest-1753132709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:54:33 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Attempting download of 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 ((None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}])) to volume 9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4. {{(pid=86366) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 21 11:54:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-65e1fa05-96c6-46fc-8fb0-998ceaeeae39 req-1d0969c5-060c-41fe-86c4-2caebf119b79 tempest-AttachVolumeNegativeTest-1753132709 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d', 'name': 'volume-9de38c29-96ff-46d0-9931-8de67f9cc390', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e8a3948-584e-4d83-bf11-46de683a7154', 'enforce_multipath': True} {{(pid=86366) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 11:54:33 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-65e1fa05-96c6-46fc-8fb0-998ceaeeae39 req-1d0969c5-060c-41fe-86c4-2caebf119b79 tempest-AttachVolumeNegativeTest-1753132709 None] attachment_update completed successfully. Sep 21 11:54:33 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[a583a59c-0c1e-4f71-b263-9d424447e8ac]: (4, 'raw') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:54:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_pd861afp {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:54:33 devstack sudo[91185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_pd861afp Sep 21 11:54:33 devstack sudo[91185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:54:33 devstack sudo[91185]: pam_unix(sudo:session): session closed for user root Sep 21 11:54:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_pd861afp" returned: 0 in 0.589s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:54:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_pd861afp {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:54:33 devstack sudo[91601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_pd861afp Sep 21 11:54:33 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:54:34 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root Sep 21 11:54:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_pd861afp" returned: 1 in 0.530s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:54:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_pd861afp' failed. Not Retrying. {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 11:54:34 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc84d535-5399-42bc-9c7a-5261870eafc2]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:54:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_kobeve2rdevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:54:34 devstack sudo[91606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_kobeve2rdevstack@QuobyteHD Sep 21 11:54:34 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:54:35 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root Sep 21 11:54:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_kobeve2rdevstack@QuobyteHD" returned: 0 in 0.769s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:54:35 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 was qcow2, converting to qcow2 {{(pid=86366) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 21 11:54:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_kobeve2rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:54:35 devstack sudo[91613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_kobeve2rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4 Sep 21 11:54:35 devstack sudo[91613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:54:37 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-2e45661a-d549-4140-9826-bd01d4052ed3 req-f80ea622-a2ae-406d-81f8-3134e49a8033 tempest-AttachVolumeNegativeTest-1753132709 None] Terminate volume connection completed successfully. Sep 21 11:54:37 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-2e45661a-d549-4140-9826-bd01d4052ed3 req-f80ea622-a2ae-406d-81f8-3134e49a8033 tempest-AttachVolumeNegativeTest-1753132709 None] Deleting attachment 0e8a3948-584e-4d83-bf11-46de683a7154. {{(pid=86366) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 11:54:38 devstack sudo[91613]: pam_unix(sudo:session): session closed for user root Sep 21 11:54:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_kobeve2rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4" returned: 0 in 3.436s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:54:38 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_kobeve2rdevstack@QuobyteHD, size 112.00 MB, duration 3.44 sec, destination /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4 {{(pid=86366) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 11:54:38 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Converted 112.00 MB image at 32.58 MB/s Sep 21 11:54:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:54:38 devstack sudo[91663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4 1G Sep 21 11:54:38 devstack sudo[91663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:54:39 devstack sudo[91663]: pam_unix(sudo:session): session closed for user root Sep 21 11:54:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4 1G" returned: 0 in 0.592s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:54:39 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Downloaded image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 ((None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}])) to volume 9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4 successfully. {{(pid=86366) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 21 11:54:39 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Temporary image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 for user 9eb47b243a624d2d98aef1b57aada116 is deleted. {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 21 11:54:39 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Marking volume 9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4 as bootable. {{(pid=86366) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 21 11:54:39 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Copying metadata from image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 to 9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4. {{(pid=86366) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 21 11:54:39 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Creating volume glance metadata for volume 9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4 backed by image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86366) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 21 11:54:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59989ca1-30d3-468d-aa63-a5999d73d782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4', 'volume_size': 1, 'image_id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6c23462c1d34d9a9d8fbc8d8872d421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'created_at': datetime.datetime(2026, 9, 21, 9, 44, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 9, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:54:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a62284-35d7-4032-b9e1-bd6b95d56716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:54:39 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Volume volume-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4 (9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4): created successfully Sep 21 11:54:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a62284-35d7-4032-b9e1-bd6b95d56716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:54:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Flow 'volume_create_manager' (080d24f6-a6c0-4d93-af18-3a5d3aaf504b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:54:39 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-43431879-dc15-47b6-a5a7-04eb04e18831 tempest-ServerActionsTestOtherA-1757437079 None] Created volume successfully. Sep 21 11:54:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-da4086c6-c4b5-4472-bdb5-cd5cd14c074c req-b05b5fbd-4dd5-472d-b89b-882dcb107ed9 tempest-ServerActionsTestOtherA-1757437079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:54:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-da4086c6-c4b5-4472-bdb5-cd5cd14c074c req-b05b5fbd-4dd5-472d-b89b-882dcb107ed9 tempest-ServerActionsTestOtherA-1757437079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:54:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-da4086c6-c4b5-4472-bdb5-cd5cd14c074c req-b05b5fbd-4dd5-472d-b89b-882dcb107ed9 tempest-ServerActionsTestOtherA-1757437079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:54:45 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-da4086c6-c4b5-4472-bdb5-cd5cd14c074c req-b05b5fbd-4dd5-472d-b89b-882dcb107ed9 tempest-ServerActionsTestOtherA-1757437079 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d', 'name': 'volume-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '34ed5ab0-8ede-49eb-b106-95e114af9227', 'enforce_multipath': True} {{(pid=86366) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 11:54:45 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-da4086c6-c4b5-4472-bdb5-cd5cd14c074c req-b05b5fbd-4dd5-472d-b89b-882dcb107ed9 tempest-ServerActionsTestOtherA-1757437079 None] attachment_update completed successfully. Sep 21 11:54:55 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=26,cinder:UPDATE=13,cinder:DELETE=2,cinder:INSERT=5 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:54:55 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=27,cinder:UPDATE=8,cinder:INSERT=10 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:55:01 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:55:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Flow 'volume_create_manager' (4346a8fb-1177-45d7-aff4-1ffb4a50c4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:55:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215bd4c4-1fa0-4d8e-8a6f-b8d838b157df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (215bd4c4-1fa0-4d8e-8a6f-b8d838b157df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-531074684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d645323d-50d5-48ec-9a92-bceb0c6f1c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c591b6fc9b943c3baf91be484a47042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:55:01Z,use_quota=True,user_id='13275be66bd7420ca97d33800442d39c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b32e99a-b86b-49e5-9e58-c6b0e210b9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b32e99a-b86b-49e5-9e58-c6b0e210b9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d56ff6c1-cf0e-4708-bafb-cdb15892761e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d56ff6c1-cf0e-4708-bafb-cdb15892761e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd645323d-50d5-48ec-9a92-bceb0c6f1c06', 'volume_name': 'volume-d645323d-50d5-48ec-9a92-bceb0c6f1c06', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6042df1-3ca2-4449-8b5c-445fac9b47b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6042df1-3ca2-4449-8b5c-445fac9b47b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c29da8d6-4614-4855-a2f6-74642c799884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:01 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Volume d645323d-50d5-48ec-9a92-bceb0c6f1c06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d645323d-50d5-48ec-9a92-bceb0c6f1c06', 'volume_size': 1} Sep 21 11:55:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-531074684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d645323d-50d5-48ec-9a92-bceb0c6f1c06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c591b6fc9b943c3baf91be484a47042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:55:01Z,use_quota=True,user_id='13275be66bd7420ca97d33800442d39c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:55:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Creating volume d645323d-50d5-48ec-9a92-bceb0c6f1c06 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:55:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:55:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:55:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:55:01 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:55:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d645323d-50d5-48ec-9a92-bceb0c6f1c06 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:01 devstack sudo[92459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d645323d-50d5-48ec-9a92-bceb0c6f1c06 1073741824 Sep 21 11:55:01 devstack sudo[92459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:02 devstack sudo[92459]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d645323d-50d5-48ec-9a92-bceb0c6f1c06 1073741824" returned: 0 in 1.368s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d645323d-50d5-48ec-9a92-bceb0c6f1c06 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:02 devstack sudo[92663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d645323d-50d5-48ec-9a92-bceb0c6f1c06 Sep 21 11:55:02 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:03 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 11:55:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:55:03 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:55:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d645323d-50d5-48ec-9a92-bceb0c6f1c06" returned: 0 in 1.018s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] <== create_volume: return (2556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:55:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.563s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:03 devstack sudo[92669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:55:03 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c29da8d6-4614-4855-a2f6-74642c799884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d645323d-50d5-48ec-9a92-bceb0c6f1c06', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d67c5eb-7fe9-4d7e-8ffa-435d3c93a2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:03 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Volume volume-d645323d-50d5-48ec-9a92-bceb0c6f1c06 (d645323d-50d5-48ec-9a92-bceb0c6f1c06): created successfully Sep 21 11:55:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d67c5eb-7fe9-4d7e-8ffa-435d3c93a2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Flow 'volume_create_manager' (4346a8fb-1177-45d7-aff4-1ffb4a50c4c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:55:04 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-a6471044-6fa7-44e4-96bb-ae9ae3a91603 tempest-AttachVolumeTestJSON-1328565065 None] Created volume successfully. Sep 21 11:55:04 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.496s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:04 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:55:04 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 11:55:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread count: 28 {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 11:55:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread info: [<_MainThread(MainThread, started 132841976594560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 11:55:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-f107e134-d711-4105-8dd8-213ce4c92e02 req-67c9326d-fe34-4739-bca9-1c8dbfb3c8e7 tempest-AttachVolumeTestJSON-1328565065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-f107e134-d711-4105-8dd8-213ce4c92e02 req-67c9326d-fe34-4739-bca9-1c8dbfb3c8e7 tempest-AttachVolumeTestJSON-1328565065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-f107e134-d711-4105-8dd8-213ce4c92e02 req-67c9326d-fe34-4739-bca9-1c8dbfb3c8e7 tempest-AttachVolumeTestJSON-1328565065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:06 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-f107e134-d711-4105-8dd8-213ce4c92e02 req-67c9326d-fe34-4739-bca9-1c8dbfb3c8e7 tempest-AttachVolumeTestJSON-1328565065 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d', 'name': 'volume-d645323d-50d5-48ec-9a92-bceb0c6f1c06', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '811b44e1-798d-4c86-9925-cb70f8b09c6e', 'enforce_multipath': True} {{(pid=86366) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 11:55:06 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-f107e134-d711-4105-8dd8-213ce4c92e02 req-67c9326d-fe34-4739-bca9-1c8dbfb3c8e7 tempest-AttachVolumeTestJSON-1328565065 None] attachment_update completed successfully. Sep 21 11:55:15 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-d93f8b6f-6e1b-4227-9655-f4d164d95300 req-c2442b37-ebbb-4d75-8332-de71b89bc32c tempest-ServerActionsTestOtherA-1757437079 None] Terminate volume connection completed successfully. Sep 21 11:55:15 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-d93f8b6f-6e1b-4227-9655-f4d164d95300 req-c2442b37-ebbb-4d75-8332-de71b89bc32c tempest-ServerActionsTestOtherA-1757437079 None] Deleting attachment 34ed5ab0-8ede-49eb-b106-95e114af9227. {{(pid=86366) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 11:55:16 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=13,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:55:19 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:55:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Flow 'volume_create_manager' (1433e537-6cf5-400d-9368-d674058b3fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:55:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (336d2357-92e2-4513-87c6-029163ee719d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (336d2357-92e2-4513-87c6-029163ee719d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1276239916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db306f79-96a3-4378-9fc2-7b454adf6a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86004e9221fb4124b49c9ef5315f5601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:55:19Z,use_quota=True,user_id='1a832cf39e7b4125ab39f5b8710577a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0557aaf-d632-462f-915d-8d7f81bc0950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0557aaf-d632-462f-915d-8d7f81bc0950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2775fb1-0b6d-480f-8e38-4b67042cf834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2775fb1-0b6d-480f-8e38-4b67042cf834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db306f79-96a3-4378-9fc2-7b454adf6a62', 'volume_name': 'volume-db306f79-96a3-4378-9fc2-7b454adf6a62', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa3b5b5b-9650-4ec8-b3c3-4b78a47ee345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa3b5b5b-9650-4ec8-b3c3-4b78a47ee345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775f7acb-41c2-4038-8de0-2c928d18af20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:19 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Volume db306f79-96a3-4378-9fc2-7b454adf6a62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db306f79-96a3-4378-9fc2-7b454adf6a62', 'volume_size': 1} Sep 21 11:55:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:19 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1276239916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db306f79-96a3-4378-9fc2-7b454adf6a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86004e9221fb4124b49c9ef5315f5601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:55:19Z,use_quota=True,user_id='1a832cf39e7b4125ab39f5b8710577a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:55:19 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Creating volume db306f79-96a3-4378-9fc2-7b454adf6a62 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:55:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:19 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:55:19 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:55:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:19 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:55:19 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:55:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-db306f79-96a3-4378-9fc2-7b454adf6a62 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:19 devstack sudo[93437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-db306f79-96a3-4378-9fc2-7b454adf6a62 1073741824 Sep 21 11:55:19 devstack sudo[93437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-d93f8b6f-6e1b-4227-9655-f4d164d95300 req-c4dbba78-ff67-4665-a759-0d366b4c8f44 tempest-ServerActionsTestOtherA-1757437079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:20 devstack sudo[93437]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-db306f79-96a3-4378-9fc2-7b454adf6a62 1073741824" returned: 0 in 0.894s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-db306f79-96a3-4378-9fc2-7b454adf6a62 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:20 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-db306f79-96a3-4378-9fc2-7b454adf6a62 Sep 21 11:55:20 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:20 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-db306f79-96a3-4378-9fc2-7b454adf6a62" returned: 0 in 0.329s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:55:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-d93f8b6f-6e1b-4227-9655-f4d164d95300 req-c4dbba78-ff67-4665-a759-0d366b4c8f44 tempest-ServerActionsTestOtherA-1757437079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.129s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775f7acb-41c2-4038-8de0-2c928d18af20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db306f79-96a3-4378-9fc2-7b454adf6a62', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a267300-2be2-4400-97bd-48713ef065db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-d93f8b6f-6e1b-4227-9655-f4d164d95300 req-c4dbba78-ff67-4665-a759-0d366b4c8f44 tempest-ServerActionsTestOtherA-1757437079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:20 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Volume volume-db306f79-96a3-4378-9fc2-7b454adf6a62 (db306f79-96a3-4378-9fc2-7b454adf6a62): created successfully Sep 21 11:55:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a267300-2be2-4400-97bd-48713ef065db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Flow 'volume_create_manager' (1433e537-6cf5-400d-9368-d674058b3fa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:55:21 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-cfb71f6c-88d8-4502-bfa5-b17218f7110c tempest-VolumesActionsTest-2104190955 None] Created volume successfully. Sep 21 11:55:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-d93f8b6f-6e1b-4227-9655-f4d164d95300 req-c4dbba78-ff67-4665-a759-0d366b4c8f44 tempest-ServerActionsTestOtherA-1757437079 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d', 'name': 'volume-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef42986b-29cf-4aae-bc9e-dc3342e46647', 'enforce_multipath': True} {{(pid=86366) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 11:55:21 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-d93f8b6f-6e1b-4227-9655-f4d164d95300 req-c4dbba78-ff67-4665-a759-0d366b4c8f44 tempest-ServerActionsTestOtherA-1757437079 None] attachment_update completed successfully. Sep 21 11:55:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1e1eef02-9f37-49d0-b154-0c14501c1fde tempest-VolumesActionsTest-2104190955 None] Acquiring lock "cinder-db306f79-96a3-4378-9fc2-7b454adf6a62" by "attach_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:55:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1e1eef02-9f37-49d0-b154-0c14501c1fde tempest-VolumesActionsTest-2104190955 None] Lock "cinder-db306f79-96a3-4378-9fc2-7b454adf6a62" acquired by "attach_volume" :: waited 0.040s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:55:22 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1e1eef02-9f37-49d0-b154-0c14501c1fde tempest-VolumesActionsTest-2104190955 None] Attaching volume db306f79-96a3-4378-9fc2-7b454adf6a62 to instance ca2bdca0-dd99-40dc-9ad4-f1be46864fca at mountpoint /dev/vdb on host None. Sep 21 11:55:22 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1e1eef02-9f37-49d0-b154-0c14501c1fde tempest-VolumesActionsTest-2104190955 None] Attach volume completed successfully. Sep 21 11:55:22 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1e1eef02-9f37-49d0-b154-0c14501c1fde tempest-VolumesActionsTest-2104190955 None] Lock "cinder-db306f79-96a3-4378-9fc2-7b454adf6a62" released by "attach_volume" :: held 0.485s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:55:23 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-672fbf5a-3921-4752-b918-cb32be6a445b tempest-VolumesActionsTest-461549993 None] Terminate volume connection completed successfully. Sep 21 11:55:23 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-672fbf5a-3921-4752-b918-cb32be6a445b tempest-VolumesActionsTest-461549993 None] Acquiring lock "cinder-db306f79-96a3-4378-9fc2-7b454adf6a62-detach_volume" by "detach_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:55:23 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-672fbf5a-3921-4752-b918-cb32be6a445b tempest-VolumesActionsTest-461549993 None] Lock "cinder-db306f79-96a3-4378-9fc2-7b454adf6a62-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:55:23 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-672fbf5a-3921-4752-b918-cb32be6a445b tempest-VolumesActionsTest-461549993 None] Detaching volume db306f79-96a3-4378-9fc2-7b454adf6a62 from instance ca2bdca0-dd99-40dc-9ad4-f1be46864fca. Sep 21 11:55:23 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-672fbf5a-3921-4752-b918-cb32be6a445b tempest-VolumesActionsTest-461549993 None] Detach volume completed successfully. Sep 21 11:55:23 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-672fbf5a-3921-4752-b918-cb32be6a445b tempest-VolumesActionsTest-461549993 None] Lock "cinder-db306f79-96a3-4378-9fc2-7b454adf6a62-detach_volume" released by "detach_volume" :: held 0.140s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:55:24 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-97cba668-b1bb-41ea-bb3b-03ff972e5439 tempest-VolumesActionsTest-2104190955 None] Acquiring lock "cinder-db306f79-96a3-4378-9fc2-7b454adf6a62-detach_volume" by "detach_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:55:24 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-97cba668-b1bb-41ea-bb3b-03ff972e5439 tempest-VolumesActionsTest-2104190955 None] Lock "cinder-db306f79-96a3-4378-9fc2-7b454adf6a62-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:55:24 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-97cba668-b1bb-41ea-bb3b-03ff972e5439 tempest-VolumesActionsTest-2104190955 None] Volume detach called, but volume not attached. Sep 21 11:55:24 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-97cba668-b1bb-41ea-bb3b-03ff972e5439 tempest-VolumesActionsTest-2104190955 None] Lock "cinder-db306f79-96a3-4378-9fc2-7b454adf6a62-detach_volume" released by "detach_volume" :: held 0.032s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:55:24 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-804d08bf-2c12-4f7c-84a3-831cb9c3d385 tempest-VolumesActionsTest-2104190955 None] Acquiring lock "cinder-db306f79-96a3-4378-9fc2-7b454adf6a62-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:55:24 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-804d08bf-2c12-4f7c-84a3-831cb9c3d385 tempest-VolumesActionsTest-2104190955 None] Lock "cinder-db306f79-96a3-4378-9fc2-7b454adf6a62-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:55:24 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-804d08bf-2c12-4f7c-84a3-831cb9c3d385 tempest-VolumesActionsTest-2104190955 None] Acquiring lock "cinder-quobyte-db306f79-96a3-4378-9fc2-7b454adf6a62" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:55:24 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-804d08bf-2c12-4f7c-84a3-831cb9c3d385 tempest-VolumesActionsTest-2104190955 None] Lock "cinder-quobyte-db306f79-96a3-4378-9fc2-7b454adf6a62" acquired by "delete_volume" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:55:24 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ad672c-1c54-4464-832f-de5b7c159fb9]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:55:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-804d08bf-2c12-4f7c-84a3-831cb9c3d385 tempest-VolumesActionsTest-2104190955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-db306f79-96a3-4378-9fc2-7b454adf6a62 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:24 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-db306f79-96a3-4378-9fc2-7b454adf6a62 Sep 21 11:55:25 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:25 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-804d08bf-2c12-4f7c-84a3-831cb9c3d385 tempest-VolumesActionsTest-2104190955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-db306f79-96a3-4378-9fc2-7b454adf6a62" returned: 0 in 0.935s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-804d08bf-2c12-4f7c-84a3-831cb9c3d385 tempest-VolumesActionsTest-2104190955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-db306f79-96a3-4378-9fc2-7b454adf6a62 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:25 devstack sudo[93523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-db306f79-96a3-4378-9fc2-7b454adf6a62 Sep 21 11:55:25 devstack sudo[93523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:26 devstack sudo[93523]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-804d08bf-2c12-4f7c-84a3-831cb9c3d385 tempest-VolumesActionsTest-2104190955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-db306f79-96a3-4378-9fc2-7b454adf6a62" returned: 0 in 0.603s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:26 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-804d08bf-2c12-4f7c-84a3-831cb9c3d385 tempest-VolumesActionsTest-2104190955 None] Lock "cinder-quobyte-db306f79-96a3-4378-9fc2-7b454adf6a62" released by "delete_volume" :: held 1.614s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:55:26 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-804d08bf-2c12-4f7c-84a3-831cb9c3d385 tempest-VolumesActionsTest-2104190955 None] Created reservations ['6160d623-371b-40c4-8a2a-4f9b2521fe59', 'a9ad62dd-2582-44ca-ad7f-d0a06468cedb', '846933f7-c9d2-4f62-b05b-3137ba50717e', '9d954ff1-1aa8-4ba1-a22a-2bfdac4bcf1b'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:55:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-804d08bf-2c12-4f7c-84a3-831cb9c3d385 tempest-VolumesActionsTest-2104190955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-804d08bf-2c12-4f7c-84a3-831cb9c3d385 tempest-VolumesActionsTest-2104190955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:26 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-804d08bf-2c12-4f7c-84a3-831cb9c3d385 tempest-VolumesActionsTest-2104190955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:55:26 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-804d08bf-2c12-4f7c-84a3-831cb9c3d385 tempest-VolumesActionsTest-2104190955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:55:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-804d08bf-2c12-4f7c-84a3-831cb9c3d385 tempest-VolumesActionsTest-2104190955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-804d08bf-2c12-4f7c-84a3-831cb9c3d385 tempest-VolumesActionsTest-2104190955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:26 devstack sudo[93528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:55:26 devstack sudo[93528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:27 devstack sudo[93528]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-804d08bf-2c12-4f7c-84a3-831cb9c3d385 tempest-VolumesActionsTest-2104190955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.610s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:27 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-804d08bf-2c12-4f7c-84a3-831cb9c3d385 tempest-VolumesActionsTest-2104190955 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:55:27 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-804d08bf-2c12-4f7c-84a3-831cb9c3d385 tempest-VolumesActionsTest-2104190955 None] Deleted volume successfully. Sep 21 11:55:27 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-804d08bf-2c12-4f7c-84a3-831cb9c3d385 tempest-VolumesActionsTest-2104190955 None] Lock "cinder-db306f79-96a3-4378-9fc2-7b454adf6a62-delete_volume" released by "delete_volume" :: held 2.749s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:55:31 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:55:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Flow 'volume_create_manager' (0fb3f029-a4dc-4a43-b3b3-4d2b560e6912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:55:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e051496-6d96-47b1-a359-cee7c1f0c4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e051496-6d96-47b1-a359-cee7c1f0c4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1931015600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b081e187-7461-4dd4-b1ef-58f0910ea653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1724e5bb6794fc8bb9e4b1bca35d859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:55:32Z,use_quota=True,user_id='b2d2b228a41c439883ed60c78a440e07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e90acd5-5733-43c5-aee2-9772fb8e553b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e90acd5-5733-43c5-aee2-9772fb8e553b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c62bb827-1380-4ff2-843a-ca5253962bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c62bb827-1380-4ff2-843a-ca5253962bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b081e187-7461-4dd4-b1ef-58f0910ea653', 'volume_name': 'volume-b081e187-7461-4dd4-b1ef-58f0910ea653', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5035c13a-bdb7-4af9-bcf5-75d456bcd70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5035c13a-bdb7-4af9-bcf5-75d456bcd70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e692903-77cd-46cb-ae33-f5567d1b24b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:31 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Volume b081e187-7461-4dd4-b1ef-58f0910ea653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b081e187-7461-4dd4-b1ef-58f0910ea653', 'volume_size': 1} Sep 21 11:55:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1931015600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b081e187-7461-4dd4-b1ef-58f0910ea653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1724e5bb6794fc8bb9e4b1bca35d859',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:55:32Z,use_quota=True,user_id='b2d2b228a41c439883ed60c78a440e07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:55:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Creating volume b081e187-7461-4dd4-b1ef-58f0910ea653 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:55:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:55:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:55:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:55:31 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:55:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b081e187-7461-4dd4-b1ef-58f0910ea653 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:31 devstack sudo[93560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b081e187-7461-4dd4-b1ef-58f0910ea653 1073741824 Sep 21 11:55:31 devstack sudo[93560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:32 devstack sudo[93560]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b081e187-7461-4dd4-b1ef-58f0910ea653 1073741824" returned: 0 in 0.761s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b081e187-7461-4dd4-b1ef-58f0910ea653 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:32 devstack sudo[93567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b081e187-7461-4dd4-b1ef-58f0910ea653 Sep 21 11:55:32 devstack sudo[93567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:32 devstack sudo[93567]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b081e187-7461-4dd4-b1ef-58f0910ea653" returned: 0 in 0.351s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:55:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:32 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e692903-77cd-46cb-ae33-f5567d1b24b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b081e187-7461-4dd4-b1ef-58f0910ea653', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:32 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a401f856-fc82-4ce5-9d9e-6d3ba27f92ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:33 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Volume volume-b081e187-7461-4dd4-b1ef-58f0910ea653 (b081e187-7461-4dd4-b1ef-58f0910ea653): created successfully Sep 21 11:55:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a401f856-fc82-4ce5-9d9e-6d3ba27f92ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Flow 'volume_create_manager' (0fb3f029-a4dc-4a43-b3b3-4d2b560e6912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:55:33 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-334d3e86-a6bc-4dbe-be58-6539af35c1f1 tempest-AttachVolumeNegativeTest-1753132709 None] Created volume successfully. Sep 21 11:55:33 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:55:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Flow 'volume_create_manager' (a9b930d5-7ac4-4e02-b02b-d2759dd98504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:55:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd69bf7-2e83-4840-92eb-b07aa9127984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd69bf7-2e83-4840-92eb-b07aa9127984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-260198927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72dae646-76ad-4036-90e9-95f3470d1f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86004e9221fb4124b49c9ef5315f5601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:55:33Z,use_quota=True,user_id='1a832cf39e7b4125ab39f5b8710577a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d567921-4a6c-4e49-b787-42d4cccfe8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d567921-4a6c-4e49-b787-42d4cccfe8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa073cc0-c793-4fcd-b075-33f1955fe0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa073cc0-c793-4fcd-b075-33f1955fe0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72dae646-76ad-4036-90e9-95f3470d1f51', 'volume_name': 'volume-72dae646-76ad-4036-90e9-95f3470d1f51', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc79d5f-7c87-42f0-b017-e79542a2831f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cc79d5f-7c87-42f0-b017-e79542a2831f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd481122-682b-43ac-8d9d-eb7c43dde2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:33 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Volume 72dae646-76ad-4036-90e9-95f3470d1f51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72dae646-76ad-4036-90e9-95f3470d1f51', 'volume_size': 1} Sep 21 11:55:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-260198927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72dae646-76ad-4036-90e9-95f3470d1f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86004e9221fb4124b49c9ef5315f5601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:55:33Z,use_quota=True,user_id='1a832cf39e7b4125ab39f5b8710577a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:55:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Creating volume 72dae646-76ad-4036-90e9-95f3470d1f51 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:55:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:55:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:55:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:55:33 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:55:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-72dae646-76ad-4036-90e9-95f3470d1f51 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:33 devstack sudo[93571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-72dae646-76ad-4036-90e9-95f3470d1f51 1073741824 Sep 21 11:55:33 devstack sudo[93571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:34 devstack sudo[93571]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-72dae646-76ad-4036-90e9-95f3470d1f51 1073741824" returned: 0 in 0.644s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-72dae646-76ad-4036-90e9-95f3470d1f51 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:34 devstack sudo[93581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-72dae646-76ad-4036-90e9-95f3470d1f51 Sep 21 11:55:34 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:34 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-72dae646-76ad-4036-90e9-95f3470d1f51" returned: 0 in 0.409s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:34 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:55:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd481122-682b-43ac-8d9d-eb7c43dde2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72dae646-76ad-4036-90e9-95f3470d1f51', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc473353-6da1-40e8-a144-d5b859dafde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:34 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Volume volume-72dae646-76ad-4036-90e9-95f3470d1f51 (72dae646-76ad-4036-90e9-95f3470d1f51): created successfully Sep 21 11:55:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc473353-6da1-40e8-a144-d5b859dafde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Flow 'volume_create_manager' (a9b930d5-7ac4-4e02-b02b-d2759dd98504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:55:34 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-360cbf8b-d813-4cb5-9c78-9d58bbb5b623 tempest-VolumesActionsTest-2104190955 None] Created volume successfully. Sep 21 11:55:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-64ee98de-6ccf-4e10-ac5c-68e9a5e9fc91 req-e49f1ca9-4bc7-4e10-a8eb-471625900526 tempest-AttachVolumeNegativeTest-1753132709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-64ee98de-6ccf-4e10-ac5c-68e9a5e9fc91 req-e49f1ca9-4bc7-4e10-a8eb-471625900526 tempest-AttachVolumeNegativeTest-1753132709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-64ee98de-6ccf-4e10-ac5c-68e9a5e9fc91 req-e49f1ca9-4bc7-4e10-a8eb-471625900526 tempest-AttachVolumeNegativeTest-1753132709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-64ee98de-6ccf-4e10-ac5c-68e9a5e9fc91 req-e49f1ca9-4bc7-4e10-a8eb-471625900526 tempest-AttachVolumeNegativeTest-1753132709 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d', 'name': 'volume-b081e187-7461-4dd4-b1ef-58f0910ea653', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1dda5519-27e0-44c3-adff-9fc7763f33b7', 'enforce_multipath': True} {{(pid=86366) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 11:55:34 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-64ee98de-6ccf-4e10-ac5c-68e9a5e9fc91 req-e49f1ca9-4bc7-4e10-a8eb-471625900526 tempest-AttachVolumeNegativeTest-1753132709 None] attachment_update completed successfully. Sep 21 11:55:35 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b2a6015d-9dff-43ab-b9e3-5264dcad4fb2 tempest-VolumesActionsTest-461549993 None] Acquiring lock "cinder-72dae646-76ad-4036-90e9-95f3470d1f51-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:55:35 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b2a6015d-9dff-43ab-b9e3-5264dcad4fb2 tempest-VolumesActionsTest-461549993 None] Lock "cinder-72dae646-76ad-4036-90e9-95f3470d1f51-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:55:35 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b2a6015d-9dff-43ab-b9e3-5264dcad4fb2 tempest-VolumesActionsTest-461549993 None] Acquiring lock "cinder-quobyte-72dae646-76ad-4036-90e9-95f3470d1f51" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:55:35 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b2a6015d-9dff-43ab-b9e3-5264dcad4fb2 tempest-VolumesActionsTest-461549993 None] Lock "cinder-quobyte-72dae646-76ad-4036-90e9-95f3470d1f51" acquired by "delete_volume" :: waited 0.024s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:55:35 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[487dae1a-ce45-4b68-bdb5-43fd3c54a4af]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:55:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b2a6015d-9dff-43ab-b9e3-5264dcad4fb2 tempest-VolumesActionsTest-461549993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-72dae646-76ad-4036-90e9-95f3470d1f51 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:36 devstack sudo[93594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-72dae646-76ad-4036-90e9-95f3470d1f51 Sep 21 11:55:36 devstack sudo[93594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:36 devstack sudo[93594]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b2a6015d-9dff-43ab-b9e3-5264dcad4fb2 tempest-VolumesActionsTest-461549993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-72dae646-76ad-4036-90e9-95f3470d1f51" returned: 0 in 0.489s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b2a6015d-9dff-43ab-b9e3-5264dcad4fb2 tempest-VolumesActionsTest-461549993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-72dae646-76ad-4036-90e9-95f3470d1f51 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:36 devstack sudo[93600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-72dae646-76ad-4036-90e9-95f3470d1f51 Sep 21 11:55:36 devstack sudo[93600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:36 devstack sudo[93600]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b2a6015d-9dff-43ab-b9e3-5264dcad4fb2 tempest-VolumesActionsTest-461549993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-72dae646-76ad-4036-90e9-95f3470d1f51" returned: 0 in 0.317s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:36 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b2a6015d-9dff-43ab-b9e3-5264dcad4fb2 tempest-VolumesActionsTest-461549993 None] Lock "cinder-quobyte-72dae646-76ad-4036-90e9-95f3470d1f51" released by "delete_volume" :: held 0.893s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:55:36 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-4ac52f75-5beb-49bd-8b07-be4511844011 req-40c45c0c-341b-4815-8d24-51759eedac00 tempest-AttachVolumeNegativeTest-1753132709 None] Terminate volume connection completed successfully. Sep 21 11:55:36 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-4ac52f75-5beb-49bd-8b07-be4511844011 req-40c45c0c-341b-4815-8d24-51759eedac00 tempest-AttachVolumeNegativeTest-1753132709 None] Deleting attachment 1dda5519-27e0-44c3-adff-9fc7763f33b7. {{(pid=86366) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 11:55:36 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-b2a6015d-9dff-43ab-b9e3-5264dcad4fb2 tempest-VolumesActionsTest-461549993 None] Created reservations ['0fa0ea5d-a9f6-4c6f-ad0b-f0dafdb608d9', '48462d2f-e13a-4ec2-b9dd-390fe3005a74', '6794e365-a214-4686-b7b6-cb47d2a13276', '91e96e7f-944f-410e-9562-4c1d696ad3b4'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:55:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b2a6015d-9dff-43ab-b9e3-5264dcad4fb2 tempest-VolumesActionsTest-461549993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b2a6015d-9dff-43ab-b9e3-5264dcad4fb2 tempest-VolumesActionsTest-461549993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:37 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b2a6015d-9dff-43ab-b9e3-5264dcad4fb2 tempest-VolumesActionsTest-461549993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:55:37 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b2a6015d-9dff-43ab-b9e3-5264dcad4fb2 tempest-VolumesActionsTest-461549993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:55:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b2a6015d-9dff-43ab-b9e3-5264dcad4fb2 tempest-VolumesActionsTest-461549993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b2a6015d-9dff-43ab-b9e3-5264dcad4fb2 tempest-VolumesActionsTest-461549993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:37 devstack sudo[93605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:55:37 devstack sudo[93605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:37 devstack sudo[93605]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b2a6015d-9dff-43ab-b9e3-5264dcad4fb2 tempest-VolumesActionsTest-461549993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.529s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:37 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-b2a6015d-9dff-43ab-b9e3-5264dcad4fb2 tempest-VolumesActionsTest-461549993 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:55:37 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-b2a6015d-9dff-43ab-b9e3-5264dcad4fb2 tempest-VolumesActionsTest-461549993 None] Deleted volume successfully. Sep 21 11:55:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b2a6015d-9dff-43ab-b9e3-5264dcad4fb2 tempest-VolumesActionsTest-461549993 None] Lock "cinder-72dae646-76ad-4036-90e9-95f3470d1f51-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:55:37 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:55:37 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Flow 'volume_create_manager' (5f63f9b6-15b7-4c83-9412-8bbd44a5e041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:55:37 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a83f4c-cea5-4d3d-9272-39991670e6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a83f4c-cea5-4d3d-9272-39991670e6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-48877824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eacf2e9-f527-413a-ac88-eb992262d14f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86004e9221fb4124b49c9ef5315f5601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:55:38Z,use_quota=True,user_id='1a832cf39e7b4125ab39f5b8710577a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a12c8675-9fcf-4162-8350-b89f20d23227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a12c8675-9fcf-4162-8350-b89f20d23227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a4924ac-8747-4816-80e3-c1da216f4a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a4924ac-8747-4816-80e3-c1da216f4a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eacf2e9-f527-413a-ac88-eb992262d14f', 'volume_name': 'volume-2eacf2e9-f527-413a-ac88-eb992262d14f', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce39998-228f-4dbc-af17-37f5ec6e0823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ce39998-228f-4dbc-af17-37f5ec6e0823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7de768f-9402-411a-a395-819ce3f33c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:38 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Volume 2eacf2e9-f527-413a-ac88-eb992262d14f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eacf2e9-f527-413a-ac88-eb992262d14f', 'volume_size': 1} Sep 21 11:55:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-48877824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eacf2e9-f527-413a-ac88-eb992262d14f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86004e9221fb4124b49c9ef5315f5601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:55:38Z,use_quota=True,user_id='1a832cf39e7b4125ab39f5b8710577a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:55:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Creating volume 2eacf2e9-f527-413a-ac88-eb992262d14f {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:55:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:55:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:55:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:55:38 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:55:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2eacf2e9-f527-413a-ac88-eb992262d14f 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:38 devstack sudo[93639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2eacf2e9-f527-413a-ac88-eb992262d14f 1073741824 Sep 21 11:55:38 devstack sudo[93639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:39 devstack sudo[93639]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2eacf2e9-f527-413a-ac88-eb992262d14f 1073741824" returned: 0 in 0.929s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2eacf2e9-f527-413a-ac88-eb992262d14f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:39 devstack sudo[93667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2eacf2e9-f527-413a-ac88-eb992262d14f Sep 21 11:55:39 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:39 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2eacf2e9-f527-413a-ac88-eb992262d14f" returned: 0 in 0.437s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:39 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:55:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7de768f-9402-411a-a395-819ce3f33c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eacf2e9-f527-413a-ac88-eb992262d14f', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7a1062-1e79-4245-a92f-809a780b4d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:39 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Volume volume-2eacf2e9-f527-413a-ac88-eb992262d14f (2eacf2e9-f527-413a-ac88-eb992262d14f): created successfully Sep 21 11:55:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7a1062-1e79-4245-a92f-809a780b4d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Flow 'volume_create_manager' (5f63f9b6-15b7-4c83-9412-8bbd44a5e041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:55:39 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-0d35be3a-b7d5-43e2-8fc2-8230f338b7ea tempest-VolumesActionsTest-2104190955 None] Created volume successfully. Sep 21 11:55:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3dfca28b-2c21-4365-939e-a4d98e1cbb25 tempest-VolumesActionsTest-461549993 None] Acquiring lock "cinder-2eacf2e9-f527-413a-ac88-eb992262d14f-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:55:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3dfca28b-2c21-4365-939e-a4d98e1cbb25 tempest-VolumesActionsTest-461549993 None] Lock "cinder-2eacf2e9-f527-413a-ac88-eb992262d14f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:55:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3dfca28b-2c21-4365-939e-a4d98e1cbb25 tempest-VolumesActionsTest-461549993 None] Acquiring lock "cinder-quobyte-2eacf2e9-f527-413a-ac88-eb992262d14f" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:55:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3dfca28b-2c21-4365-939e-a4d98e1cbb25 tempest-VolumesActionsTest-461549993 None] Lock "cinder-quobyte-2eacf2e9-f527-413a-ac88-eb992262d14f" acquired by "delete_volume" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:55:40 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[9524e08a-0220-4991-a672-2a74dddc6735]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:55:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3dfca28b-2c21-4365-939e-a4d98e1cbb25 tempest-VolumesActionsTest-461549993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2eacf2e9-f527-413a-ac88-eb992262d14f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:40 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2eacf2e9-f527-413a-ac88-eb992262d14f Sep 21 11:55:40 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:40 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3dfca28b-2c21-4365-939e-a4d98e1cbb25 tempest-VolumesActionsTest-461549993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2eacf2e9-f527-413a-ac88-eb992262d14f" returned: 0 in 0.461s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3dfca28b-2c21-4365-939e-a4d98e1cbb25 tempest-VolumesActionsTest-461549993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2eacf2e9-f527-413a-ac88-eb992262d14f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:40 devstack sudo[93679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2eacf2e9-f527-413a-ac88-eb992262d14f Sep 21 11:55:40 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:41 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3dfca28b-2c21-4365-939e-a4d98e1cbb25 tempest-VolumesActionsTest-461549993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2eacf2e9-f527-413a-ac88-eb992262d14f" returned: 0 in 0.353s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:41 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3dfca28b-2c21-4365-939e-a4d98e1cbb25 tempest-VolumesActionsTest-461549993 None] Lock "cinder-quobyte-2eacf2e9-f527-413a-ac88-eb992262d14f" released by "delete_volume" :: held 0.878s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:55:41 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-3dfca28b-2c21-4365-939e-a4d98e1cbb25 tempest-VolumesActionsTest-461549993 None] Created reservations ['fd99e5d5-e850-4b40-8d71-0bec9faa1ef4', 'a809d969-7d1b-4ced-b774-a5a06ac78979', 'bac1b601-a158-4b83-83c1-379f00c5f545', '5882d21e-5bb3-42ea-b4d4-556fbfb2bf95'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:55:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3dfca28b-2c21-4365-939e-a4d98e1cbb25 tempest-VolumesActionsTest-461549993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3dfca28b-2c21-4365-939e-a4d98e1cbb25 tempest-VolumesActionsTest-461549993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:41 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3dfca28b-2c21-4365-939e-a4d98e1cbb25 tempest-VolumesActionsTest-461549993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:55:41 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3dfca28b-2c21-4365-939e-a4d98e1cbb25 tempest-VolumesActionsTest-461549993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:55:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3dfca28b-2c21-4365-939e-a4d98e1cbb25 tempest-VolumesActionsTest-461549993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3dfca28b-2c21-4365-939e-a4d98e1cbb25 tempest-VolumesActionsTest-461549993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:41 devstack sudo[93682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:55:41 devstack sudo[93682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:41 devstack sudo[93682]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3dfca28b-2c21-4365-939e-a4d98e1cbb25 tempest-VolumesActionsTest-461549993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.348s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:41 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-3dfca28b-2c21-4365-939e-a4d98e1cbb25 tempest-VolumesActionsTest-461549993 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:55:41 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-3dfca28b-2c21-4365-939e-a4d98e1cbb25 tempest-VolumesActionsTest-461549993 None] Deleted volume successfully. Sep 21 11:55:41 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3dfca28b-2c21-4365-939e-a4d98e1cbb25 tempest-VolumesActionsTest-461549993 None] Lock "cinder-2eacf2e9-f527-413a-ac88-eb992262d14f-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Flow 'volume_create_manager' (74e60ff8-c6e1-4bd7-84a2-f5af7bb467e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e5b0261-9a79-41e7-b78c-bc148dc089d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-359d5667-325d-4092-a242-0637f6c298fc tempest-AttachVolumeNegativeTest-1753132709 None] Acquiring lock "cinder-b081e187-7461-4dd4-b1ef-58f0910ea653-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e5b0261-9a79-41e7-b78c-bc148dc089d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1567402921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fff1a14-b578-4e94-b81a-ec62fb6519d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86004e9221fb4124b49c9ef5315f5601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:55:42Z,use_quota=True,user_id='1a832cf39e7b4125ab39f5b8710577a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c850275e-ad62-4e8b-9f89-fb4e1a5935b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c850275e-ad62-4e8b-9f89-fb4e1a5935b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59186337-b717-4eb9-b0f6-8053ec46fb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59186337-b717-4eb9-b0f6-8053ec46fb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fff1a14-b578-4e94-b81a-ec62fb6519d9', 'volume_name': 'volume-8fff1a14-b578-4e94-b81a-ec62fb6519d9', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f05eaa5-b027-4644-ac38-f6a3177668db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f05eaa5-b027-4644-ac38-f6a3177668db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5916d88-f27e-4913-8b65-02277082ccdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:42 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Volume 8fff1a14-b578-4e94-b81a-ec62fb6519d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fff1a14-b578-4e94-b81a-ec62fb6519d9', 'volume_size': 1} Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1567402921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fff1a14-b578-4e94-b81a-ec62fb6519d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86004e9221fb4124b49c9ef5315f5601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:55:42Z,use_quota=True,user_id='1a832cf39e7b4125ab39f5b8710577a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Creating volume 8fff1a14-b578-4e94-b81a-ec62fb6519d9 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:55:42 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8fff1a14-b578-4e94-b81a-ec62fb6519d9 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-359d5667-325d-4092-a242-0637f6c298fc tempest-AttachVolumeNegativeTest-1753132709 None] Lock "cinder-b081e187-7461-4dd4-b1ef-58f0910ea653-delete_volume" acquired by "delete_volume" :: waited 0.134s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:55:42 devstack sudo[93685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8fff1a14-b578-4e94-b81a-ec62fb6519d9 1073741824 Sep 21 11:55:42 devstack sudo[93685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-359d5667-325d-4092-a242-0637f6c298fc tempest-AttachVolumeNegativeTest-1753132709 None] Acquiring lock "cinder-quobyte-b081e187-7461-4dd4-b1ef-58f0910ea653" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-359d5667-325d-4092-a242-0637f6c298fc tempest-AttachVolumeNegativeTest-1753132709 None] Lock "cinder-quobyte-b081e187-7461-4dd4-b1ef-58f0910ea653" acquired by "delete_volume" :: waited 0.027s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3495665-aebc-485f-adaa-64c6c260eae1]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-359d5667-325d-4092-a242-0637f6c298fc tempest-AttachVolumeNegativeTest-1753132709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b081e187-7461-4dd4-b1ef-58f0910ea653 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:42 devstack sudo[93687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b081e187-7461-4dd4-b1ef-58f0910ea653 Sep 21 11:55:42 devstack sudo[93687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:42 devstack sudo[93685]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8fff1a14-b578-4e94-b81a-ec62fb6519d9 1073741824" returned: 0 in 0.528s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8fff1a14-b578-4e94-b81a-ec62fb6519d9 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:42 devstack sudo[93697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8fff1a14-b578-4e94-b81a-ec62fb6519d9 Sep 21 11:55:42 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:43 devstack sudo[93687]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-359d5667-325d-4092-a242-0637f6c298fc tempest-AttachVolumeNegativeTest-1753132709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b081e187-7461-4dd4-b1ef-58f0910ea653" returned: 0 in 0.492s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-359d5667-325d-4092-a242-0637f6c298fc tempest-AttachVolumeNegativeTest-1753132709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b081e187-7461-4dd4-b1ef-58f0910ea653 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:43 devstack sudo[93699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b081e187-7461-4dd4-b1ef-58f0910ea653 Sep 21 11:55:43 devstack sudo[93699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:43 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8fff1a14-b578-4e94-b81a-ec62fb6519d9" returned: 0 in 0.271s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:43 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:55:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5916d88-f27e-4913-8b65-02277082ccdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fff1a14-b578-4e94-b81a-ec62fb6519d9', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29d5174d-2e4a-4255-9828-8c18725037c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:43 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Volume volume-8fff1a14-b578-4e94-b81a-ec62fb6519d9 (8fff1a14-b578-4e94-b81a-ec62fb6519d9): created successfully Sep 21 11:55:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29d5174d-2e4a-4255-9828-8c18725037c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Flow 'volume_create_manager' (74e60ff8-c6e1-4bd7-84a2-f5af7bb467e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:55:43 devstack sudo[93699]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-359d5667-325d-4092-a242-0637f6c298fc tempest-AttachVolumeNegativeTest-1753132709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b081e187-7461-4dd4-b1ef-58f0910ea653" returned: 0 in 0.281s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:43 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-359d5667-325d-4092-a242-0637f6c298fc tempest-AttachVolumeNegativeTest-1753132709 None] Lock "cinder-quobyte-b081e187-7461-4dd4-b1ef-58f0910ea653" released by "delete_volume" :: held 0.823s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:55:43 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-47e88839-7c70-4836-99be-8cadbfd62a9f tempest-VolumesActionsTest-2104190955 None] Created volume successfully. Sep 21 11:55:43 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-359d5667-325d-4092-a242-0637f6c298fc tempest-AttachVolumeNegativeTest-1753132709 None] Created reservations ['4198892c-fa17-4862-a399-e0fbc62b6e8b', 'bbb28e9a-8170-4ab6-a8be-80c1a3939306', 'e49def4c-0669-4752-b567-e7b8666ce629', '0df28cc5-cdb8-4a55-b7c0-29fe41e9d61c'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:55:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-359d5667-325d-4092-a242-0637f6c298fc tempest-AttachVolumeNegativeTest-1753132709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-359d5667-325d-4092-a242-0637f6c298fc tempest-AttachVolumeNegativeTest-1753132709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:43 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-359d5667-325d-4092-a242-0637f6c298fc tempest-AttachVolumeNegativeTest-1753132709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:55:43 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-359d5667-325d-4092-a242-0637f6c298fc tempest-AttachVolumeNegativeTest-1753132709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:55:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-359d5667-325d-4092-a242-0637f6c298fc tempest-AttachVolumeNegativeTest-1753132709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-359d5667-325d-4092-a242-0637f6c298fc tempest-AttachVolumeNegativeTest-1753132709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:43 devstack sudo[93703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:55:43 devstack sudo[93703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:43 devstack sudo[93703]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-359d5667-325d-4092-a242-0637f6c298fc tempest-AttachVolumeNegativeTest-1753132709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.251s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:43 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-359d5667-325d-4092-a242-0637f6c298fc tempest-AttachVolumeNegativeTest-1753132709 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:55:43 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-359d5667-325d-4092-a242-0637f6c298fc tempest-AttachVolumeNegativeTest-1753132709 None] Deleted volume successfully. Sep 21 11:55:43 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-359d5667-325d-4092-a242-0637f6c298fc tempest-AttachVolumeNegativeTest-1753132709 None] Lock "cinder-b081e187-7461-4dd4-b1ef-58f0910ea653-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:55:44 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-d3229e1c-54d4-40a6-a2a0-35c3c61305e7 tempest-VolumesActionsTest-461549993 None] Acquiring lock "cinder-8fff1a14-b578-4e94-b81a-ec62fb6519d9-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:55:44 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-d3229e1c-54d4-40a6-a2a0-35c3c61305e7 tempest-VolumesActionsTest-461549993 None] Lock "cinder-8fff1a14-b578-4e94-b81a-ec62fb6519d9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:55:44 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-d3229e1c-54d4-40a6-a2a0-35c3c61305e7 tempest-VolumesActionsTest-461549993 None] Acquiring lock "cinder-quobyte-8fff1a14-b578-4e94-b81a-ec62fb6519d9" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:55:44 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-d3229e1c-54d4-40a6-a2a0-35c3c61305e7 tempest-VolumesActionsTest-461549993 None] Lock "cinder-quobyte-8fff1a14-b578-4e94-b81a-ec62fb6519d9" acquired by "delete_volume" :: waited 0.043s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:55:44 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-af827bd1-7231-421c-bc6c-7b4dc781b8e0 tempest-AttachVolumeNegativeTest-1753132709 None] Acquiring lock "cinder-9de38c29-96ff-46d0-9931-8de67f9cc390-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:55:44 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[8910b0db-b7f8-4c14-b517-b06090f43a41]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:55:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d3229e1c-54d4-40a6-a2a0-35c3c61305e7 tempest-VolumesActionsTest-461549993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8fff1a14-b578-4e94-b81a-ec62fb6519d9 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:44 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-af827bd1-7231-421c-bc6c-7b4dc781b8e0 tempest-AttachVolumeNegativeTest-1753132709 None] Lock "cinder-9de38c29-96ff-46d0-9931-8de67f9cc390-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:55:44 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-af827bd1-7231-421c-bc6c-7b4dc781b8e0 tempest-AttachVolumeNegativeTest-1753132709 None] Acquiring lock "cinder-quobyte-9de38c29-96ff-46d0-9931-8de67f9cc390" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:55:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-af827bd1-7231-421c-bc6c-7b4dc781b8e0 tempest-AttachVolumeNegativeTest-1753132709 None] Lock "cinder-quobyte-9de38c29-96ff-46d0-9931-8de67f9cc390" acquired by "delete_volume" :: waited 0.028s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:55:45 devstack sudo[93779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8fff1a14-b578-4e94-b81a-ec62fb6519d9 Sep 21 11:55:45 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:45 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0fba11-61e8-4a14-95ba-022ac33e410a]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:55:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-af827bd1-7231-421c-bc6c-7b4dc781b8e0 tempest-AttachVolumeNegativeTest-1753132709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9de38c29-96ff-46d0-9931-8de67f9cc390 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:45 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9de38c29-96ff-46d0-9931-8de67f9cc390 Sep 21 11:55:45 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:45 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d3229e1c-54d4-40a6-a2a0-35c3c61305e7 tempest-VolumesActionsTest-461549993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8fff1a14-b578-4e94-b81a-ec62fb6519d9" returned: 0 in 0.684s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d3229e1c-54d4-40a6-a2a0-35c3c61305e7 tempest-VolumesActionsTest-461549993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8fff1a14-b578-4e94-b81a-ec62fb6519d9 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:45 devstack sudo[93808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8fff1a14-b578-4e94-b81a-ec62fb6519d9 Sep 21 11:55:45 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:45 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-af827bd1-7231-421c-bc6c-7b4dc781b8e0 tempest-AttachVolumeNegativeTest-1753132709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9de38c29-96ff-46d0-9931-8de67f9cc390" returned: 0 in 0.687s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-af827bd1-7231-421c-bc6c-7b4dc781b8e0 tempest-AttachVolumeNegativeTest-1753132709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9de38c29-96ff-46d0-9931-8de67f9cc390 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:45 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9de38c29-96ff-46d0-9931-8de67f9cc390 Sep 21 11:55:45 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:45 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d3229e1c-54d4-40a6-a2a0-35c3c61305e7 tempest-VolumesActionsTest-461549993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8fff1a14-b578-4e94-b81a-ec62fb6519d9" returned: 0 in 0.423s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-d3229e1c-54d4-40a6-a2a0-35c3c61305e7 tempest-VolumesActionsTest-461549993 None] Lock "cinder-quobyte-8fff1a14-b578-4e94-b81a-ec62fb6519d9" released by "delete_volume" :: held 1.219s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:55:46 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-af827bd1-7231-421c-bc6c-7b4dc781b8e0 tempest-AttachVolumeNegativeTest-1753132709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9de38c29-96ff-46d0-9931-8de67f9cc390" returned: 0 in 0.310s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:46 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-d3229e1c-54d4-40a6-a2a0-35c3c61305e7 tempest-VolumesActionsTest-461549993 None] Created reservations ['ad729919-7b59-449d-a156-7acdc79aca24', '5b30f569-3a75-4b51-96c5-7771b201f8ed', '6b5fadf0-2f74-427f-b361-12fd92f1c6f3', 'de5c2170-cc03-4d25-8a9e-b863e46a8080'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:55:46 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-af827bd1-7231-421c-bc6c-7b4dc781b8e0 tempest-AttachVolumeNegativeTest-1753132709 None] Lock "cinder-quobyte-9de38c29-96ff-46d0-9931-8de67f9cc390" released by "delete_volume" :: held 1.075s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:55:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d3229e1c-54d4-40a6-a2a0-35c3c61305e7 tempest-VolumesActionsTest-461549993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d3229e1c-54d4-40a6-a2a0-35c3c61305e7 tempest-VolumesActionsTest-461549993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d3229e1c-54d4-40a6-a2a0-35c3c61305e7 tempest-VolumesActionsTest-461549993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:55:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d3229e1c-54d4-40a6-a2a0-35c3c61305e7 tempest-VolumesActionsTest-461549993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:55:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d3229e1c-54d4-40a6-a2a0-35c3c61305e7 tempest-VolumesActionsTest-461549993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d3229e1c-54d4-40a6-a2a0-35c3c61305e7 tempest-VolumesActionsTest-461549993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:46 devstack sudo[93817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:55:46 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-af827bd1-7231-421c-bc6c-7b4dc781b8e0 tempest-AttachVolumeNegativeTest-1753132709 None] Created reservations ['02026543-2f35-4f56-9dae-dff377300b8c', 'd7e08891-967d-486e-986d-7d4baef61973', '6eaec601-2798-4ea9-a6ae-d322b04f11c1', '29543e82-f0ff-4487-b1e8-731b442b6d61'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:55:46 devstack sudo[93817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-af827bd1-7231-421c-bc6c-7b4dc781b8e0 tempest-AttachVolumeNegativeTest-1753132709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-af827bd1-7231-421c-bc6c-7b4dc781b8e0 tempest-AttachVolumeNegativeTest-1753132709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-af827bd1-7231-421c-bc6c-7b4dc781b8e0 tempest-AttachVolumeNegativeTest-1753132709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:55:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-af827bd1-7231-421c-bc6c-7b4dc781b8e0 tempest-AttachVolumeNegativeTest-1753132709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:55:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-af827bd1-7231-421c-bc6c-7b4dc781b8e0 tempest-AttachVolumeNegativeTest-1753132709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-af827bd1-7231-421c-bc6c-7b4dc781b8e0 tempest-AttachVolumeNegativeTest-1753132709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:46 devstack sudo[93819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:55:46 devstack sudo[93819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:46 devstack sudo[93817]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d3229e1c-54d4-40a6-a2a0-35c3c61305e7 tempest-VolumesActionsTest-461549993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.349s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:46 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-d3229e1c-54d4-40a6-a2a0-35c3c61305e7 tempest-VolumesActionsTest-461549993 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:55:46 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-d3229e1c-54d4-40a6-a2a0-35c3c61305e7 tempest-VolumesActionsTest-461549993 None] Deleted volume successfully. Sep 21 11:55:46 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-d3229e1c-54d4-40a6-a2a0-35c3c61305e7 tempest-VolumesActionsTest-461549993 None] Lock "cinder-8fff1a14-b578-4e94-b81a-ec62fb6519d9-delete_volume" released by "delete_volume" :: held 1.967s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:55:46 devstack sudo[93819]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-af827bd1-7231-421c-bc6c-7b4dc781b8e0 tempest-AttachVolumeNegativeTest-1753132709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.274s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:46 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-af827bd1-7231-421c-bc6c-7b4dc781b8e0 tempest-AttachVolumeNegativeTest-1753132709 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:55:46 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-af827bd1-7231-421c-bc6c-7b4dc781b8e0 tempest-AttachVolumeNegativeTest-1753132709 None] Deleted volume successfully. Sep 21 11:55:46 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-af827bd1-7231-421c-bc6c-7b4dc781b8e0 tempest-AttachVolumeNegativeTest-1753132709 None] Lock "cinder-9de38c29-96ff-46d0-9931-8de67f9cc390-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-97200859-4462-43f8-a913-245efdb05cd7 tempest-AttachVolumeNegativeTest-1753132709 None] Acquiring lock "cinder-c4ee8809-700b-40ca-81cb-1f7c83606f85-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-97200859-4462-43f8-a913-245efdb05cd7 tempest-AttachVolumeNegativeTest-1753132709 None] Lock "cinder-c4ee8809-700b-40ca-81cb-1f7c83606f85-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-97200859-4462-43f8-a913-245efdb05cd7 tempest-AttachVolumeNegativeTest-1753132709 None] Acquiring lock "cinder-quobyte-c4ee8809-700b-40ca-81cb-1f7c83606f85" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-97200859-4462-43f8-a913-245efdb05cd7 tempest-AttachVolumeNegativeTest-1753132709 None] Lock "cinder-quobyte-c4ee8809-700b-40ca-81cb-1f7c83606f85" acquired by "delete_volume" :: waited 0.016s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d7b788-53e3-44ed-9349-3d939bc05d47]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-97200859-4462-43f8-a913-245efdb05cd7 tempest-AttachVolumeNegativeTest-1753132709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c4ee8809-700b-40ca-81cb-1f7c83606f85 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Flow 'volume_create_manager' (5c670813-1605-4cab-9846-da679161282a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a64858b-128c-4136-8beb-5607c82b48ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a64858b-128c-4136-8beb-5607c82b48ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-826349418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f61d6ba-8dda-4dfb-940c-f61331e43766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86004e9221fb4124b49c9ef5315f5601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:55:47Z,use_quota=True,user_id='1a832cf39e7b4125ab39f5b8710577a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b513f4b3-73f1-43d5-9034-e7757ac963d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b513f4b3-73f1-43d5-9034-e7757ac963d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf5c345-22f1-4a5f-b3d6-3ed64ccfa853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf5c345-22f1-4a5f-b3d6-3ed64ccfa853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f61d6ba-8dda-4dfb-940c-f61331e43766', 'volume_name': 'volume-6f61d6ba-8dda-4dfb-940c-f61331e43766', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ff5226-8b3e-484a-b035-48ac2758e0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ff5226-8b3e-484a-b035-48ac2758e0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:47 devstack sudo[93823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c4ee8809-700b-40ca-81cb-1f7c83606f85 Sep 21 11:55:47 devstack sudo[93823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49655915-c24a-4027-b6d7-a24e7216b358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:47 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Volume 6f61d6ba-8dda-4dfb-940c-f61331e43766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f61d6ba-8dda-4dfb-940c-f61331e43766', 'volume_size': 1} Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-826349418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f61d6ba-8dda-4dfb-940c-f61331e43766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86004e9221fb4124b49c9ef5315f5601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:55:47Z,use_quota=True,user_id='1a832cf39e7b4125ab39f5b8710577a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Creating volume 6f61d6ba-8dda-4dfb-940c-f61331e43766 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:55:47 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6f61d6ba-8dda-4dfb-940c-f61331e43766 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:47 devstack sudo[93825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6f61d6ba-8dda-4dfb-940c-f61331e43766 1073741824 Sep 21 11:55:47 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:47 devstack sudo[93823]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-97200859-4462-43f8-a913-245efdb05cd7 tempest-AttachVolumeNegativeTest-1753132709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c4ee8809-700b-40ca-81cb-1f7c83606f85" returned: 0 in 0.397s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-97200859-4462-43f8-a913-245efdb05cd7 tempest-AttachVolumeNegativeTest-1753132709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c4ee8809-700b-40ca-81cb-1f7c83606f85 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:47 devstack sudo[93833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c4ee8809-700b-40ca-81cb-1f7c83606f85 Sep 21 11:55:47 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:48 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6f61d6ba-8dda-4dfb-940c-f61331e43766 1073741824" returned: 0 in 0.465s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6f61d6ba-8dda-4dfb-940c-f61331e43766 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:48 devstack sudo[93837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6f61d6ba-8dda-4dfb-940c-f61331e43766 Sep 21 11:55:48 devstack sudo[93837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:48 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-97200859-4462-43f8-a913-245efdb05cd7 tempest-AttachVolumeNegativeTest-1753132709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c4ee8809-700b-40ca-81cb-1f7c83606f85" returned: 0 in 0.266s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:48 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-97200859-4462-43f8-a913-245efdb05cd7 tempest-AttachVolumeNegativeTest-1753132709 None] Lock "cinder-quobyte-c4ee8809-700b-40ca-81cb-1f7c83606f85" released by "delete_volume" :: held 0.717s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:55:48 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-97200859-4462-43f8-a913-245efdb05cd7 tempest-AttachVolumeNegativeTest-1753132709 None] Created reservations ['4c0075a1-91c4-48c7-80ac-f184b32f677a', 'bb010b7c-d3e6-4ff0-9c4c-0e0329281ac9', 'dbd179dc-e61d-44cd-8c4d-64ef2b3e84d5', 'cc0dfceb-22b3-4958-a9f6-6e95881d9f9c'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:55:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-97200859-4462-43f8-a913-245efdb05cd7 tempest-AttachVolumeNegativeTest-1753132709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-97200859-4462-43f8-a913-245efdb05cd7 tempest-AttachVolumeNegativeTest-1753132709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:48 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-97200859-4462-43f8-a913-245efdb05cd7 tempest-AttachVolumeNegativeTest-1753132709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:55:48 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-97200859-4462-43f8-a913-245efdb05cd7 tempest-AttachVolumeNegativeTest-1753132709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:55:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-97200859-4462-43f8-a913-245efdb05cd7 tempest-AttachVolumeNegativeTest-1753132709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-97200859-4462-43f8-a913-245efdb05cd7 tempest-AttachVolumeNegativeTest-1753132709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:48 devstack sudo[93839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:55:48 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:48 devstack sudo[93837]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6f61d6ba-8dda-4dfb-940c-f61331e43766" returned: 0 in 0.264s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:48 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:55:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:48 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49655915-c24a-4027-b6d7-a24e7216b358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f61d6ba-8dda-4dfb-940c-f61331e43766', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:48 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6013a03-f7f2-42a0-b52e-48100e46c957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:48 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Volume volume-6f61d6ba-8dda-4dfb-940c-f61331e43766 (6f61d6ba-8dda-4dfb-940c-f61331e43766): created successfully Sep 21 11:55:48 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6013a03-f7f2-42a0-b52e-48100e46c957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:48 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Flow 'volume_create_manager' (5c670813-1605-4cab-9846-da679161282a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:55:48 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-84787f44-72cf-45aa-8f82-969f8648d4b8 tempest-VolumesActionsTest-2104190955 None] Created volume successfully. Sep 21 11:55:48 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-97200859-4462-43f8-a913-245efdb05cd7 tempest-AttachVolumeNegativeTest-1753132709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.291s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:48 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-97200859-4462-43f8-a913-245efdb05cd7 tempest-AttachVolumeNegativeTest-1753132709 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:55:48 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-97200859-4462-43f8-a913-245efdb05cd7 tempest-AttachVolumeNegativeTest-1753132709 None] Deleted volume successfully. Sep 21 11:55:48 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-97200859-4462-43f8-a913-245efdb05cd7 tempest-AttachVolumeNegativeTest-1753132709 None] Lock "cinder-c4ee8809-700b-40ca-81cb-1f7c83606f85-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:55:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-329e56b7-4014-49f4-a747-87f08bc00066 tempest-VolumesActionsTest-461549993 None] Acquiring lock "cinder-6f61d6ba-8dda-4dfb-940c-f61331e43766-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:55:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-329e56b7-4014-49f4-a747-87f08bc00066 tempest-VolumesActionsTest-461549993 None] Lock "cinder-6f61d6ba-8dda-4dfb-940c-f61331e43766-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:55:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-329e56b7-4014-49f4-a747-87f08bc00066 tempest-VolumesActionsTest-461549993 None] Acquiring lock "cinder-quobyte-6f61d6ba-8dda-4dfb-940c-f61331e43766" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:55:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-329e56b7-4014-49f4-a747-87f08bc00066 tempest-VolumesActionsTest-461549993 None] Lock "cinder-quobyte-6f61d6ba-8dda-4dfb-940c-f61331e43766" acquired by "delete_volume" :: waited 0.023s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:55:49 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fabc191-aff5-4249-a885-e99b73bc49d9]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:55:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-329e56b7-4014-49f4-a747-87f08bc00066 tempest-VolumesActionsTest-461549993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6f61d6ba-8dda-4dfb-940c-f61331e43766 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:50 devstack sudo[93860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6f61d6ba-8dda-4dfb-940c-f61331e43766 Sep 21 11:55:50 devstack sudo[93860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:50 devstack sudo[93860]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-329e56b7-4014-49f4-a747-87f08bc00066 tempest-VolumesActionsTest-461549993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6f61d6ba-8dda-4dfb-940c-f61331e43766" returned: 0 in 0.467s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-329e56b7-4014-49f4-a747-87f08bc00066 tempest-VolumesActionsTest-461549993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6f61d6ba-8dda-4dfb-940c-f61331e43766 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:50 devstack sudo[93870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6f61d6ba-8dda-4dfb-940c-f61331e43766 Sep 21 11:55:50 devstack sudo[93870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:50 devstack sudo[93870]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-329e56b7-4014-49f4-a747-87f08bc00066 tempest-VolumesActionsTest-461549993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6f61d6ba-8dda-4dfb-940c-f61331e43766" returned: 0 in 0.272s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:50 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-329e56b7-4014-49f4-a747-87f08bc00066 tempest-VolumesActionsTest-461549993 None] Lock "cinder-quobyte-6f61d6ba-8dda-4dfb-940c-f61331e43766" released by "delete_volume" :: held 0.796s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:55:50 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-329e56b7-4014-49f4-a747-87f08bc00066 tempest-VolumesActionsTest-461549993 None] Created reservations ['3b8bbae1-7eaf-418c-9f64-457adf45e764', '6986020f-629d-4105-bf1e-5521c312c2a7', 'b7901f0d-4281-41e0-b02e-d583a3379164', '17e94661-628e-44a6-89d2-da77a9ffd28d'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:55:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-329e56b7-4014-49f4-a747-87f08bc00066 tempest-VolumesActionsTest-461549993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-329e56b7-4014-49f4-a747-87f08bc00066 tempest-VolumesActionsTest-461549993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:50 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-329e56b7-4014-49f4-a747-87f08bc00066 tempest-VolumesActionsTest-461549993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:55:50 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-329e56b7-4014-49f4-a747-87f08bc00066 tempest-VolumesActionsTest-461549993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:55:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-329e56b7-4014-49f4-a747-87f08bc00066 tempest-VolumesActionsTest-461549993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-329e56b7-4014-49f4-a747-87f08bc00066 tempest-VolumesActionsTest-461549993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:50 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:55:50 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:51 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-329e56b7-4014-49f4-a747-87f08bc00066 tempest-VolumesActionsTest-461549993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.292s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:51 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-329e56b7-4014-49f4-a747-87f08bc00066 tempest-VolumesActionsTest-461549993 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:55:51 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-329e56b7-4014-49f4-a747-87f08bc00066 tempest-VolumesActionsTest-461549993 None] Deleted volume successfully. Sep 21 11:55:51 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-329e56b7-4014-49f4-a747-87f08bc00066 tempest-VolumesActionsTest-461549993 None] Lock "cinder-6f61d6ba-8dda-4dfb-940c-f61331e43766-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:55:51 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:55:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Flow 'volume_create_manager' (fd40b935-05e1-465b-aaf0-ed041ac94f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:55:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a8b9dd-56c9-4b3e-b049-719c667ead6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a8b9dd-56c9-4b3e-b049-719c667ead6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-636155434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb6c72d-dc20-4491-a09e-f4a53d0e8cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86004e9221fb4124b49c9ef5315f5601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:55:52Z,use_quota=True,user_id='1a832cf39e7b4125ab39f5b8710577a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45cc5641-87c2-4879-abf4-cfbc0b8aef68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45cc5641-87c2-4879-abf4-cfbc0b8aef68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d581831-530d-4101-a557-44d34f5eece2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d581831-530d-4101-a557-44d34f5eece2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bb6c72d-dc20-4491-a09e-f4a53d0e8cd7', 'volume_name': 'volume-1bb6c72d-dc20-4491-a09e-f4a53d0e8cd7', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c9e818-30bc-435e-94ee-7ea5349dd99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c9e818-30bc-435e-94ee-7ea5349dd99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc566d18-9f8f-4b70-a75a-80541e6b026c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:51 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Volume 1bb6c72d-dc20-4491-a09e-f4a53d0e8cd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bb6c72d-dc20-4491-a09e-f4a53d0e8cd7', 'volume_size': 1} Sep 21 11:55:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-636155434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb6c72d-dc20-4491-a09e-f4a53d0e8cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86004e9221fb4124b49c9ef5315f5601',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:55:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:55:52Z,use_quota=True,user_id='1a832cf39e7b4125ab39f5b8710577a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:55:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Creating volume 1bb6c72d-dc20-4491-a09e-f4a53d0e8cd7 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:55:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:55:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:55:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:55:51 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:55:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bb6c72d-dc20-4491-a09e-f4a53d0e8cd7 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:51 devstack sudo[93876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bb6c72d-dc20-4491-a09e-f4a53d0e8cd7 1073741824 Sep 21 11:55:51 devstack sudo[93876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:52 devstack sudo[93876]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bb6c72d-dc20-4491-a09e-f4a53d0e8cd7 1073741824" returned: 0 in 0.495s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bb6c72d-dc20-4491-a09e-f4a53d0e8cd7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:52 devstack sudo[93883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bb6c72d-dc20-4491-a09e-f4a53d0e8cd7 Sep 21 11:55:52 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:52 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bb6c72d-dc20-4491-a09e-f4a53d0e8cd7" returned: 0 in 0.413s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:55:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc566d18-9f8f-4b70-a75a-80541e6b026c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bb6c72d-dc20-4491-a09e-f4a53d0e8cd7', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b76061b9-9222-459f-a73f-3d5c07ca8698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:55:52 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Volume volume-1bb6c72d-dc20-4491-a09e-f4a53d0e8cd7 (1bb6c72d-dc20-4491-a09e-f4a53d0e8cd7): created successfully Sep 21 11:55:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b76061b9-9222-459f-a73f-3d5c07ca8698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:55:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Flow 'volume_create_manager' (fd40b935-05e1-465b-aaf0-ed041ac94f02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:55:52 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-2078d63c-fa5d-4226-ab1f-7ee3e48a3b94 tempest-VolumesActionsTest-2104190955 None] Created volume successfully. Sep 21 11:55:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5cc55840-3794-4f1e-9b6f-b6dfd947c9c0 tempest-VolumesActionsTest-2104190955 None] Acquiring lock "cinder-1bb6c72d-dc20-4491-a09e-f4a53d0e8cd7-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:55:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5cc55840-3794-4f1e-9b6f-b6dfd947c9c0 tempest-VolumesActionsTest-2104190955 None] Lock "cinder-1bb6c72d-dc20-4491-a09e-f4a53d0e8cd7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:55:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5cc55840-3794-4f1e-9b6f-b6dfd947c9c0 tempest-VolumesActionsTest-2104190955 None] Acquiring lock "cinder-quobyte-1bb6c72d-dc20-4491-a09e-f4a53d0e8cd7" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:55:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5cc55840-3794-4f1e-9b6f-b6dfd947c9c0 tempest-VolumesActionsTest-2104190955 None] Lock "cinder-quobyte-1bb6c72d-dc20-4491-a09e-f4a53d0e8cd7" acquired by "delete_volume" :: waited 0.018s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:55:54 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88cae94-967b-40eb-89aa-3c956bd0a7fb]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:55:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5cc55840-3794-4f1e-9b6f-b6dfd947c9c0 tempest-VolumesActionsTest-2104190955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bb6c72d-dc20-4491-a09e-f4a53d0e8cd7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:54 devstack sudo[93887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bb6c72d-dc20-4491-a09e-f4a53d0e8cd7 Sep 21 11:55:54 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:55 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5cc55840-3794-4f1e-9b6f-b6dfd947c9c0 tempest-VolumesActionsTest-2104190955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bb6c72d-dc20-4491-a09e-f4a53d0e8cd7" returned: 0 in 0.446s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5cc55840-3794-4f1e-9b6f-b6dfd947c9c0 tempest-VolumesActionsTest-2104190955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bb6c72d-dc20-4491-a09e-f4a53d0e8cd7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:55 devstack sudo[93894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bb6c72d-dc20-4491-a09e-f4a53d0e8cd7 Sep 21 11:55:55 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:55 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5cc55840-3794-4f1e-9b6f-b6dfd947c9c0 tempest-VolumesActionsTest-2104190955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bb6c72d-dc20-4491-a09e-f4a53d0e8cd7" returned: 0 in 0.262s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5cc55840-3794-4f1e-9b6f-b6dfd947c9c0 tempest-VolumesActionsTest-2104190955 None] Lock "cinder-quobyte-1bb6c72d-dc20-4491-a09e-f4a53d0e8cd7" released by "delete_volume" :: held 0.773s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:55:55 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:UPDATE=103,cinder:DELETE=7,cinder:SELECT=81,cinder:INSERT=19 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:55:55 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-5cc55840-3794-4f1e-9b6f-b6dfd947c9c0 tempest-VolumesActionsTest-2104190955 None] Created reservations ['af1d30c4-2f46-4886-9d96-0a0b773219c5', '9464e9a7-7fa0-4a7a-95c4-c340945e036f', '471b246f-ed51-4695-bbd8-91f4958a9e4d', '47f61dd9-82c1-428c-9634-4ec66c4bb2ce'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:55:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5cc55840-3794-4f1e-9b6f-b6dfd947c9c0 tempest-VolumesActionsTest-2104190955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5cc55840-3794-4f1e-9b6f-b6dfd947c9c0 tempest-VolumesActionsTest-2104190955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:55 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5cc55840-3794-4f1e-9b6f-b6dfd947c9c0 tempest-VolumesActionsTest-2104190955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:55:55 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5cc55840-3794-4f1e-9b6f-b6dfd947c9c0 tempest-VolumesActionsTest-2104190955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:55:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5cc55840-3794-4f1e-9b6f-b6dfd947c9c0 tempest-VolumesActionsTest-2104190955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5cc55840-3794-4f1e-9b6f-b6dfd947c9c0 tempest-VolumesActionsTest-2104190955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:55 devstack sudo[93899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:55:55 devstack sudo[93899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:55 devstack sudo[93899]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5cc55840-3794-4f1e-9b6f-b6dfd947c9c0 tempest-VolumesActionsTest-2104190955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.387s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:55 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-5cc55840-3794-4f1e-9b6f-b6dfd947c9c0 tempest-VolumesActionsTest-2104190955 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:55:55 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-5cc55840-3794-4f1e-9b6f-b6dfd947c9c0 tempest-VolumesActionsTest-2104190955 None] Deleted volume successfully. Sep 21 11:55:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5cc55840-3794-4f1e-9b6f-b6dfd947c9c0 tempest-VolumesActionsTest-2104190955 None] Lock "cinder-1bb6c72d-dc20-4491-a09e-f4a53d0e8cd7-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:55:57 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-418b5e1d-914a-4d43-8d99-688d9f7549da req-27e0f43d-3f96-47eb-a42f-293149e9e06b tempest-ServerActionsTestOtherA-1757437079 None] Terminate volume connection completed successfully. Sep 21 11:55:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-418b5e1d-914a-4d43-8d99-688d9f7549da req-27e0f43d-3f96-47eb-a42f-293149e9e06b tempest-ServerActionsTestOtherA-1757437079 None] Deleting attachment ef42986b-29cf-4aae-bc9e-dc3342e46647. {{(pid=86366) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 11:55:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3cff4c9c-a503-49c3-bef6-6abf9833a81f tempest-BackendsCapabilitiesAdminTestsJSON-2058318167 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6625900268555, 'free_capacity_gb': 1775.6625900268555, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86366) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 21 11:55:58 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-418b5e1d-914a-4d43-8d99-688d9f7549da req-c8580ce6-6fa3-479f-add1-1e5e00c6e7ee tempest-ServerActionsTestOtherA-1757437079 None] Acquiring lock "cinder-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:55:58 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-418b5e1d-914a-4d43-8d99-688d9f7549da req-c8580ce6-6fa3-479f-add1-1e5e00c6e7ee tempest-ServerActionsTestOtherA-1757437079 None] Lock "cinder-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:55:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7a4492e1-9f11-4dab-a8d7-c3ce5cc04673 tempest-BackendsCapabilitiesAdminTestsJSON-2058318167 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6625900268555, 'free_capacity_gb': 1775.6625900268555, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86366) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 21 11:55:58 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-418b5e1d-914a-4d43-8d99-688d9f7549da req-c8580ce6-6fa3-479f-add1-1e5e00c6e7ee tempest-ServerActionsTestOtherA-1757437079 None] Acquiring lock "cinder-quobyte-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:55:58 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-418b5e1d-914a-4d43-8d99-688d9f7549da req-c8580ce6-6fa3-479f-add1-1e5e00c6e7ee tempest-ServerActionsTestOtherA-1757437079 None] Lock "cinder-quobyte-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4" acquired by "delete_volume" :: waited 0.030s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:55:58 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23da090-0987-44f5-a046-e7ea4a820ae9]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:55:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-418b5e1d-914a-4d43-8d99-688d9f7549da req-c8580ce6-6fa3-479f-add1-1e5e00c6e7ee tempest-ServerActionsTestOtherA-1757437079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:58 devstack sudo[93930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4 Sep 21 11:55:58 devstack sudo[93930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:58 devstack sudo[93930]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-418b5e1d-914a-4d43-8d99-688d9f7549da req-c8580ce6-6fa3-479f-add1-1e5e00c6e7ee tempest-ServerActionsTestOtherA-1757437079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4" returned: 0 in 0.516s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-418b5e1d-914a-4d43-8d99-688d9f7549da req-c8580ce6-6fa3-479f-add1-1e5e00c6e7ee tempest-ServerActionsTestOtherA-1757437079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:58 devstack sudo[93942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4 Sep 21 11:55:58 devstack sudo[93942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-bd3c663f-2a30-44a2-af51-b315f69d5ba9 tempest-ServerActionsTestOtherA-1757437079 None] Acquiring lock "cinder-c1025f83-1946-4609-84ff-0ceb47818c4b-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:55:59 devstack sudo[93942]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-418b5e1d-914a-4d43-8d99-688d9f7549da req-c8580ce6-6fa3-479f-add1-1e5e00c6e7ee tempest-ServerActionsTestOtherA-1757437079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4" returned: 0 in 0.440s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-bd3c663f-2a30-44a2-af51-b315f69d5ba9 tempest-ServerActionsTestOtherA-1757437079 None] Lock "cinder-c1025f83-1946-4609-84ff-0ceb47818c4b-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:55:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-418b5e1d-914a-4d43-8d99-688d9f7549da req-c8580ce6-6fa3-479f-add1-1e5e00c6e7ee tempest-ServerActionsTestOtherA-1757437079 None] Lock "cinder-quobyte-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4" released by "delete_volume" :: held 1.048s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:55:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-bd3c663f-2a30-44a2-af51-b315f69d5ba9 tempest-ServerActionsTestOtherA-1757437079 None] Acquiring lock "cinder-quobyte-c1025f83-1946-4609-84ff-0ceb47818c4b" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:55:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-bd3c663f-2a30-44a2-af51-b315f69d5ba9 tempest-ServerActionsTestOtherA-1757437079 None] Lock "cinder-quobyte-c1025f83-1946-4609-84ff-0ceb47818c4b" acquired by "delete_volume" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:55:59 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e69283-7da4-4bff-ab83-296a85ddca5d]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:55:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bd3c663f-2a30-44a2-af51-b315f69d5ba9 tempest-ServerActionsTestOtherA-1757437079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c1025f83-1946-4609-84ff-0ceb47818c4b {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:59 devstack cinder-volume[86366]: DEBUG cinder.quota [req-418b5e1d-914a-4d43-8d99-688d9f7549da req-c8580ce6-6fa3-479f-add1-1e5e00c6e7ee tempest-ServerActionsTestOtherA-1757437079 None] Created reservations ['b0f6386b-90cd-4461-8198-fc8434a169dd', 'b1485e12-0956-43be-9930-f49b798dcccd', '8e83528b-337f-49e7-b960-a5c0f8dbb2ff', '4edf9bce-23e6-44f9-9652-74a2d11ef6d6'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:55:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-418b5e1d-914a-4d43-8d99-688d9f7549da req-c8580ce6-6fa3-479f-add1-1e5e00c6e7ee tempest-ServerActionsTestOtherA-1757437079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:55:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-418b5e1d-914a-4d43-8d99-688d9f7549da req-c8580ce6-6fa3-479f-add1-1e5e00c6e7ee tempest-ServerActionsTestOtherA-1757437079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:55:59 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [req-418b5e1d-914a-4d43-8d99-688d9f7549da req-c8580ce6-6fa3-479f-add1-1e5e00c6e7ee tempest-ServerActionsTestOtherA-1757437079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:55:59 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [req-418b5e1d-914a-4d43-8d99-688d9f7549da req-c8580ce6-6fa3-479f-add1-1e5e00c6e7ee tempest-ServerActionsTestOtherA-1757437079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:55:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-418b5e1d-914a-4d43-8d99-688d9f7549da req-c8580ce6-6fa3-479f-add1-1e5e00c6e7ee tempest-ServerActionsTestOtherA-1757437079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:55:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-418b5e1d-914a-4d43-8d99-688d9f7549da req-c8580ce6-6fa3-479f-add1-1e5e00c6e7ee tempest-ServerActionsTestOtherA-1757437079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:55:59 devstack sudo[93949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:55:59 devstack sudo[93949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:59 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c1025f83-1946-4609-84ff-0ceb47818c4b Sep 21 11:55:59 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:55:59 devstack sudo[93949]: pam_unix(sudo:session): session closed for user root Sep 21 11:55:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-418b5e1d-914a-4d43-8d99-688d9f7549da req-c8580ce6-6fa3-479f-add1-1e5e00c6e7ee tempest-ServerActionsTestOtherA-1757437079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.353s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:55:59 devstack cinder-volume[86366]: DEBUG cinder.manager [req-418b5e1d-914a-4d43-8d99-688d9f7549da req-c8580ce6-6fa3-479f-add1-1e5e00c6e7ee tempest-ServerActionsTestOtherA-1757437079 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:55:59 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-418b5e1d-914a-4d43-8d99-688d9f7549da req-c8580ce6-6fa3-479f-add1-1e5e00c6e7ee tempest-ServerActionsTestOtherA-1757437079 None] Deleted volume successfully. Sep 21 11:55:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-418b5e1d-914a-4d43-8d99-688d9f7549da req-c8580ce6-6fa3-479f-add1-1e5e00c6e7ee tempest-ServerActionsTestOtherA-1757437079 None] Lock "cinder-9a6522de-d7a4-4b73-9ce5-7dfab2bf6cd4-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:56:00 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-1f79e698-deb7-4399-ac6e-9e8f00784bb4 req-7c25b8f9-b797-4552-9c41-c10e0798f2ef tempest-AttachVolumeTestJSON-1328565065 None] Terminate volume connection completed successfully. Sep 21 11:56:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-1f79e698-deb7-4399-ac6e-9e8f00784bb4 req-7c25b8f9-b797-4552-9c41-c10e0798f2ef tempest-AttachVolumeTestJSON-1328565065 None] Deleting attachment 811b44e1-798d-4c86-9925-cb70f8b09c6e. {{(pid=86366) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 11:56:00 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Sep 21 11:56:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bd3c663f-2a30-44a2-af51-b315f69d5ba9 tempest-ServerActionsTestOtherA-1757437079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c1025f83-1946-4609-84ff-0ceb47818c4b" returned: 0 in 0.715s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:56:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bd3c663f-2a30-44a2-af51-b315f69d5ba9 tempest-ServerActionsTestOtherA-1757437079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c1025f83-1946-4609-84ff-0ceb47818c4b {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:56:00 devstack sudo[93959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c1025f83-1946-4609-84ff-0ceb47818c4b Sep 21 11:56:00 devstack sudo[93959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:56:00 devstack sudo[93959]: pam_unix(sudo:session): session closed for user root Sep 21 11:56:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bd3c663f-2a30-44a2-af51-b315f69d5ba9 tempest-ServerActionsTestOtherA-1757437079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c1025f83-1946-4609-84ff-0ceb47818c4b" returned: 0 in 0.298s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:56:00 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-bd3c663f-2a30-44a2-af51-b315f69d5ba9 tempest-ServerActionsTestOtherA-1757437079 None] Lock "cinder-quobyte-c1025f83-1946-4609-84ff-0ceb47818c4b" released by "delete_volume" :: held 1.066s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:56:00 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-bd3c663f-2a30-44a2-af51-b315f69d5ba9 tempest-ServerActionsTestOtherA-1757437079 None] Created reservations ['42ac0ddd-9280-4473-9ab3-4e6d0631006d', '44456f2c-d27f-49ea-9e9e-39af1c7d9ffe', '94645ec5-6a25-4f38-97e1-ccfcccd5f9a6', '89a14416-0cb9-4736-88dc-e416a0df89bc'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:56:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-bd3c663f-2a30-44a2-af51-b315f69d5ba9 tempest-ServerActionsTestOtherA-1757437079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:56:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-bd3c663f-2a30-44a2-af51-b315f69d5ba9 tempest-ServerActionsTestOtherA-1757437079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:56:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-bd3c663f-2a30-44a2-af51-b315f69d5ba9 tempest-ServerActionsTestOtherA-1757437079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:56:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-bd3c663f-2a30-44a2-af51-b315f69d5ba9 tempest-ServerActionsTestOtherA-1757437079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:56:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-bd3c663f-2a30-44a2-af51-b315f69d5ba9 tempest-ServerActionsTestOtherA-1757437079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:56:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bd3c663f-2a30-44a2-af51-b315f69d5ba9 tempest-ServerActionsTestOtherA-1757437079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:56:00 devstack sudo[93962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:56:00 devstack sudo[93962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:56:00 devstack sudo[93962]: pam_unix(sudo:session): session closed for user root Sep 21 11:56:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bd3c663f-2a30-44a2-af51-b315f69d5ba9 tempest-ServerActionsTestOtherA-1757437079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.377s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:56:00 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-bd3c663f-2a30-44a2-af51-b315f69d5ba9 tempest-ServerActionsTestOtherA-1757437079 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:56:00 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-bd3c663f-2a30-44a2-af51-b315f69d5ba9 tempest-ServerActionsTestOtherA-1757437079 None] Deleted volume successfully. Sep 21 11:56:00 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-bd3c663f-2a30-44a2-af51-b315f69d5ba9 tempest-ServerActionsTestOtherA-1757437079 None] Lock "cinder-c1025f83-1946-4609-84ff-0ceb47818c4b-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:56:03 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 11:56:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:56:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:56:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:56:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:56:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:56:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:56:03 devstack sudo[93996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:56:03 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:56:04 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root Sep 21 11:56:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.531s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:56:04 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:56:04 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 11:56:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread count: 28 {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 11:56:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread info: [<_MainThread(MainThread, started 132841976594560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 11:56:10 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:INSERT=4,cinder:UPDATE=22,cinder:SELECT=15,cinder:DELETE=1 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:56:10 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=96,cinder:INSERT=30,cinder:UPDATE=113,cinder:DELETE=11 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:56:20 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:56:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Flow 'volume_create_manager' (3b44aa08-1d01-4bae-9d2b-eceb22d76eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:56:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8525ec3d-0220-41e1-a354-489f798d4435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8525ec3d-0220-41e1-a354-489f798d4435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1845031786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc6bb99b-2391-4b9e-bca8-a4eda056e2a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b805e1b70e94501bbc32f5c0d7f1a36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:56:20Z,use_quota=True,user_id='6d3c1c0c86484304b770158c95001a78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89a23d89-b84d-4d8e-a7f0-de295ed120cf),volume_type_id=89a23d89-b84d-4d8e-a7f0-de295ed120cf)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a599f802-aec8-41cf-84fc-c17cf2285cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a599f802-aec8-41cf-84fc-c17cf2285cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b65cb0-42f4-4d8e-b198-4230036d4337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b65cb0-42f4-4d8e-b198-4230036d4337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc6bb99b-2391-4b9e-bca8-a4eda056e2a3', 'volume_name': 'volume-fc6bb99b-2391-4b9e-bca8-a4eda056e2a3', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91c74fc-44a1-440c-8ead-9f10dc49314a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d91c74fc-44a1-440c-8ead-9f10dc49314a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf18b68-8241-4b9b-bb90-72cf3465913d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:20 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Volume fc6bb99b-2391-4b9e-bca8-a4eda056e2a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc6bb99b-2391-4b9e-bca8-a4eda056e2a3', 'volume_size': 1} Sep 21 11:56:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:56:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:56:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1845031786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc6bb99b-2391-4b9e-bca8-a4eda056e2a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b805e1b70e94501bbc32f5c0d7f1a36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:56:20Z,use_quota=True,user_id='6d3c1c0c86484304b770158c95001a78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89a23d89-b84d-4d8e-a7f0-de295ed120cf),volume_type_id=89a23d89-b84d-4d8e-a7f0-de295ed120cf)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:56:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Creating volume fc6bb99b-2391-4b9e-bca8-a4eda056e2a3 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:56:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:56:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:56:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:56:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:56:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:56:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:56:20 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:56:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-fc6bb99b-2391-4b9e-bca8-a4eda056e2a3 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:56:20 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-fc6bb99b-2391-4b9e-bca8-a4eda056e2a3 1073741824 Sep 21 11:56:20 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:56:21 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Sep 21 11:56:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-fc6bb99b-2391-4b9e-bca8-a4eda056e2a3 1073741824" returned: 0 in 0.714s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:56:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-fc6bb99b-2391-4b9e-bca8-a4eda056e2a3 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:56:21 devstack sudo[94110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-fc6bb99b-2391-4b9e-bca8-a4eda056e2a3 Sep 21 11:56:21 devstack sudo[94110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:56:21 devstack sudo[94110]: pam_unix(sudo:session): session closed for user root Sep 21 11:56:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-fc6bb99b-2391-4b9e-bca8-a4eda056e2a3" returned: 0 in 0.298s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:56:21 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:56:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:56:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf18b68-8241-4b9b-bb90-72cf3465913d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc6bb99b-2391-4b9e-bca8-a4eda056e2a3', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (977ec7cc-b14e-4065-93b1-5a9a61e576cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:21 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Volume volume-fc6bb99b-2391-4b9e-bca8-a4eda056e2a3 (fc6bb99b-2391-4b9e-bca8-a4eda056e2a3): created successfully Sep 21 11:56:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (977ec7cc-b14e-4065-93b1-5a9a61e576cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Flow 'volume_create_manager' (3b44aa08-1d01-4bae-9d2b-eceb22d76eb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:56:21 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-d0d271ec-1075-42c7-a228-214e816c659f tempest-VolumeTypesAccessTest-438534451 None] Created volume successfully. Sep 21 11:56:22 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b96f29a5-2ba6-4727-b657-3c771d71662c tempest-VolumeTypesAccessTest-438534451 None] Acquiring lock "cinder-fc6bb99b-2391-4b9e-bca8-a4eda056e2a3-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:56:22 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b96f29a5-2ba6-4727-b657-3c771d71662c tempest-VolumeTypesAccessTest-438534451 None] Lock "cinder-fc6bb99b-2391-4b9e-bca8-a4eda056e2a3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:56:22 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b96f29a5-2ba6-4727-b657-3c771d71662c tempest-VolumeTypesAccessTest-438534451 None] Acquiring lock "cinder-quobyte-fc6bb99b-2391-4b9e-bca8-a4eda056e2a3" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:56:22 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b96f29a5-2ba6-4727-b657-3c771d71662c tempest-VolumeTypesAccessTest-438534451 None] Lock "cinder-quobyte-fc6bb99b-2391-4b9e-bca8-a4eda056e2a3" acquired by "delete_volume" :: waited 0.017s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:56:22 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9697d8-88c7-4cb8-88ff-c0d04390a934]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:56:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b96f29a5-2ba6-4727-b657-3c771d71662c tempest-VolumeTypesAccessTest-438534451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-fc6bb99b-2391-4b9e-bca8-a4eda056e2a3 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:56:22 devstack sudo[94113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-fc6bb99b-2391-4b9e-bca8-a4eda056e2a3 Sep 21 11:56:22 devstack sudo[94113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:56:23 devstack sudo[94113]: pam_unix(sudo:session): session closed for user root Sep 21 11:56:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b96f29a5-2ba6-4727-b657-3c771d71662c tempest-VolumeTypesAccessTest-438534451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-fc6bb99b-2391-4b9e-bca8-a4eda056e2a3" returned: 0 in 0.453s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:56:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b96f29a5-2ba6-4727-b657-3c771d71662c tempest-VolumeTypesAccessTest-438534451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-fc6bb99b-2391-4b9e-bca8-a4eda056e2a3 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:56:23 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-fc6bb99b-2391-4b9e-bca8-a4eda056e2a3 Sep 21 11:56:23 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:56:23 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Sep 21 11:56:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b96f29a5-2ba6-4727-b657-3c771d71662c tempest-VolumeTypesAccessTest-438534451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-fc6bb99b-2391-4b9e-bca8-a4eda056e2a3" returned: 0 in 0.310s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:56:23 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b96f29a5-2ba6-4727-b657-3c771d71662c tempest-VolumeTypesAccessTest-438534451 None] Lock "cinder-quobyte-fc6bb99b-2391-4b9e-bca8-a4eda056e2a3" released by "delete_volume" :: held 0.847s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:56:23 devstack cinder-volume[86366]: WARNING cinder.quota [None req-b96f29a5-2ba6-4727-b657-3c771d71662c tempest-VolumeTypesAccessTest-438534451 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-13716688 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-13716688, it is now deprecated. Please use the default quota class for default quota. Sep 21 11:56:23 devstack cinder-volume[86366]: WARNING cinder.quota [None req-b96f29a5-2ba6-4727-b657-3c771d71662c tempest-VolumeTypesAccessTest-438534451 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-13716688 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-13716688, it is now deprecated. Please use the default quota class for default quota. Sep 21 11:56:23 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-b96f29a5-2ba6-4727-b657-3c771d71662c tempest-VolumeTypesAccessTest-438534451 None] Created reservations ['4e0c717c-6e30-419e-a1c9-257f85dafda7', '4ac24075-ea13-4001-b805-36663eab404f', '20a88f13-5934-4685-8ea1-489b3304c1d3', '9446dc50-b1a6-413e-9415-d579121b1fd2'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:56:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b96f29a5-2ba6-4727-b657-3c771d71662c tempest-VolumeTypesAccessTest-438534451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:56:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b96f29a5-2ba6-4727-b657-3c771d71662c tempest-VolumeTypesAccessTest-438534451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:56:23 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b96f29a5-2ba6-4727-b657-3c771d71662c tempest-VolumeTypesAccessTest-438534451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:56:23 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b96f29a5-2ba6-4727-b657-3c771d71662c tempest-VolumeTypesAccessTest-438534451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:56:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b96f29a5-2ba6-4727-b657-3c771d71662c tempest-VolumeTypesAccessTest-438534451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:56:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b96f29a5-2ba6-4727-b657-3c771d71662c tempest-VolumeTypesAccessTest-438534451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:56:23 devstack sudo[94121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:56:23 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:56:24 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root Sep 21 11:56:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b96f29a5-2ba6-4727-b657-3c771d71662c tempest-VolumeTypesAccessTest-438534451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.415s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:56:24 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-b96f29a5-2ba6-4727-b657-3c771d71662c tempest-VolumeTypesAccessTest-438534451 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:56:24 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-b96f29a5-2ba6-4727-b657-3c771d71662c tempest-VolumeTypesAccessTest-438534451 None] Deleted volume successfully. Sep 21 11:56:24 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b96f29a5-2ba6-4727-b657-3c771d71662c tempest-VolumeTypesAccessTest-438534451 None] Lock "cinder-fc6bb99b-2391-4b9e-bca8-a4eda056e2a3-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:56:25 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:56:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Flow 'volume_create_manager' (97b8c488-a63f-45c9-8f95-d68ebd656399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:56:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9627cf40-1c7c-42de-a9f4-9a9eb299b86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9627cf40-1c7c-42de-a9f4-9a9eb299b86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2000769762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3020789f-8145-4399-8ee6-d4f81d0a9990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='807b8550c7f544bd86e98f386ade64c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:56:25Z,use_quota=True,user_id='b5a9735165f94aacbaa16eca9494716a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7648c3a1-35b2-4050-a4d6-5de80e49c9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7648c3a1-35b2-4050-a4d6-5de80e49c9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14af2357-60d5-46c2-913a-7af1349012a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14af2357-60d5-46c2-913a-7af1349012a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3020789f-8145-4399-8ee6-d4f81d0a9990', 'volume_name': 'volume-3020789f-8145-4399-8ee6-d4f81d0a9990', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca64117-7f2d-4353-a5fd-1810fc44c081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ca64117-7f2d-4353-a5fd-1810fc44c081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371368ef-1fa8-425b-a3b3-5a285a520a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:25 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Volume 3020789f-8145-4399-8ee6-d4f81d0a9990: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3020789f-8145-4399-8ee6-d4f81d0a9990', 'volume_size': 1} Sep 21 11:56:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:56:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:56:25 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2000769762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3020789f-8145-4399-8ee6-d4f81d0a9990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='807b8550c7f544bd86e98f386ade64c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:56:25Z,use_quota=True,user_id='b5a9735165f94aacbaa16eca9494716a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:56:25 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Creating volume 3020789f-8145-4399-8ee6-d4f81d0a9990 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:56:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:56:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:56:25 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:56:25 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:56:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:56:25 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:56:25 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:56:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3020789f-8145-4399-8ee6-d4f81d0a9990 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:56:25 devstack sudo[94124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3020789f-8145-4399-8ee6-d4f81d0a9990 1073741824 Sep 21 11:56:25 devstack sudo[94124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:56:26 devstack sudo[94124]: pam_unix(sudo:session): session closed for user root Sep 21 11:56:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3020789f-8145-4399-8ee6-d4f81d0a9990 1073741824" returned: 0 in 0.598s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:56:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3020789f-8145-4399-8ee6-d4f81d0a9990 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:56:26 devstack sudo[94131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3020789f-8145-4399-8ee6-d4f81d0a9990 Sep 21 11:56:26 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:56:26 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root Sep 21 11:56:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3020789f-8145-4399-8ee6-d4f81d0a9990" returned: 0 in 0.327s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:56:26 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:56:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:56:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (371368ef-1fa8-425b-a3b3-5a285a520a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3020789f-8145-4399-8ee6-d4f81d0a9990', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47afee3e-459d-4c6b-bc9f-d9417c68d361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:26 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Volume volume-3020789f-8145-4399-8ee6-d4f81d0a9990 (3020789f-8145-4399-8ee6-d4f81d0a9990): created successfully Sep 21 11:56:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47afee3e-459d-4c6b-bc9f-d9417c68d361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Flow 'volume_create_manager' (97b8c488-a63f-45c9-8f95-d68ebd656399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:56:26 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-d692b3e4-ced5-42ff-88ea-1f71b7ae86af tempest-AbsoluteLimitsTests-1738228681 None] Created volume successfully. Sep 21 11:56:28 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4408437f-5c8e-4804-ab3a-f8a215a9dc8c tempest-AbsoluteLimitsTests-1738228681 None] Acquiring lock "cinder-3020789f-8145-4399-8ee6-d4f81d0a9990-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:56:28 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4408437f-5c8e-4804-ab3a-f8a215a9dc8c tempest-AbsoluteLimitsTests-1738228681 None] Lock "cinder-3020789f-8145-4399-8ee6-d4f81d0a9990-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:56:28 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4408437f-5c8e-4804-ab3a-f8a215a9dc8c tempest-AbsoluteLimitsTests-1738228681 None] Acquiring lock "cinder-quobyte-3020789f-8145-4399-8ee6-d4f81d0a9990" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:56:28 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4408437f-5c8e-4804-ab3a-f8a215a9dc8c tempest-AbsoluteLimitsTests-1738228681 None] Lock "cinder-quobyte-3020789f-8145-4399-8ee6-d4f81d0a9990" acquired by "delete_volume" :: waited 0.018s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:56:28 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[862e71b9-6163-4dbc-b627-9004947eb015]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:56:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4408437f-5c8e-4804-ab3a-f8a215a9dc8c tempest-AbsoluteLimitsTests-1738228681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3020789f-8145-4399-8ee6-d4f81d0a9990 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:56:28 devstack sudo[94134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3020789f-8145-4399-8ee6-d4f81d0a9990 Sep 21 11:56:28 devstack sudo[94134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:56:28 devstack sudo[94134]: pam_unix(sudo:session): session closed for user root Sep 21 11:56:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4408437f-5c8e-4804-ab3a-f8a215a9dc8c tempest-AbsoluteLimitsTests-1738228681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3020789f-8145-4399-8ee6-d4f81d0a9990" returned: 0 in 0.478s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:56:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4408437f-5c8e-4804-ab3a-f8a215a9dc8c tempest-AbsoluteLimitsTests-1738228681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3020789f-8145-4399-8ee6-d4f81d0a9990 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:56:28 devstack sudo[94142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3020789f-8145-4399-8ee6-d4f81d0a9990 Sep 21 11:56:28 devstack sudo[94142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:56:29 devstack sudo[94142]: pam_unix(sudo:session): session closed for user root Sep 21 11:56:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4408437f-5c8e-4804-ab3a-f8a215a9dc8c tempest-AbsoluteLimitsTests-1738228681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3020789f-8145-4399-8ee6-d4f81d0a9990" returned: 0 in 0.348s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:56:29 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4408437f-5c8e-4804-ab3a-f8a215a9dc8c tempest-AbsoluteLimitsTests-1738228681 None] Lock "cinder-quobyte-3020789f-8145-4399-8ee6-d4f81d0a9990" released by "delete_volume" :: held 0.893s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:56:29 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-4408437f-5c8e-4804-ab3a-f8a215a9dc8c tempest-AbsoluteLimitsTests-1738228681 None] Created reservations ['c7134579-ed38-40fa-bc46-008f577af0c6', 'a301de14-8e74-4d7a-b2e5-fba41ed2a422', 'c707af2d-5080-442b-84f3-22c4b7b844c9', '8e3f4833-991c-425a-8734-cf12ea447e17'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:56:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4408437f-5c8e-4804-ab3a-f8a215a9dc8c tempest-AbsoluteLimitsTests-1738228681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:56:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4408437f-5c8e-4804-ab3a-f8a215a9dc8c tempest-AbsoluteLimitsTests-1738228681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:56:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4408437f-5c8e-4804-ab3a-f8a215a9dc8c tempest-AbsoluteLimitsTests-1738228681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:56:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4408437f-5c8e-4804-ab3a-f8a215a9dc8c tempest-AbsoluteLimitsTests-1738228681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:56:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4408437f-5c8e-4804-ab3a-f8a215a9dc8c tempest-AbsoluteLimitsTests-1738228681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:56:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4408437f-5c8e-4804-ab3a-f8a215a9dc8c tempest-AbsoluteLimitsTests-1738228681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:56:29 devstack sudo[94145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:56:29 devstack sudo[94145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:56:29 devstack sudo[94145]: pam_unix(sudo:session): session closed for user root Sep 21 11:56:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4408437f-5c8e-4804-ab3a-f8a215a9dc8c tempest-AbsoluteLimitsTests-1738228681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.513s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:56:29 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-4408437f-5c8e-4804-ab3a-f8a215a9dc8c tempest-AbsoluteLimitsTests-1738228681 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:56:29 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-4408437f-5c8e-4804-ab3a-f8a215a9dc8c tempest-AbsoluteLimitsTests-1738228681 None] Deleted volume successfully. Sep 21 11:56:29 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4408437f-5c8e-4804-ab3a-f8a215a9dc8c tempest-AbsoluteLimitsTests-1738228681 None] Lock "cinder-3020789f-8145-4399-8ee6-d4f81d0a9990-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:56:38 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:56:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Flow 'volume_create_manager' (a502e9e6-c9c2-4903-b6ec-6830b1164fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:56:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e7c16b-8591-40df-b2d5-d01c40514d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e7c16b-8591-40df-b2d5-d01c40514d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2004921562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e85b060a-973f-4054-87c1-299400c8804a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111f04ad3c7447388007ca388092cee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:56:39Z,use_quota=True,user_id='4b45c54649844178bd0f2f5e4f40bfcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fca442f-9492-4ba7-80b2-0cc1b66cdf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fca442f-9492-4ba7-80b2-0cc1b66cdf51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d9e26ef-46ba-4ceb-ae22-ee69817b7d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d9e26ef-46ba-4ceb-ae22-ee69817b7d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e85b060a-973f-4054-87c1-299400c8804a', 'volume_name': 'volume-e85b060a-973f-4054-87c1-299400c8804a', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b08ac7a-a508-4ea3-9edc-adf675223a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b08ac7a-a508-4ea3-9edc-adf675223a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6eb1e03-35a4-4a16-9eac-43625ede679d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:38 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Volume e85b060a-973f-4054-87c1-299400c8804a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e85b060a-973f-4054-87c1-299400c8804a', 'volume_size': 1} Sep 21 11:56:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:56:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:56:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2004921562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e85b060a-973f-4054-87c1-299400c8804a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='111f04ad3c7447388007ca388092cee6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:56:39Z,use_quota=True,user_id='4b45c54649844178bd0f2f5e4f40bfcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:56:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Creating volume e85b060a-973f-4054-87c1-299400c8804a {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:56:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:56:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:56:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:56:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:56:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:56:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:56:38 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:56:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e85b060a-973f-4054-87c1-299400c8804a 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:56:38 devstack sudo[94197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e85b060a-973f-4054-87c1-299400c8804a 1073741824 Sep 21 11:56:38 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:56:39 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root Sep 21 11:56:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e85b060a-973f-4054-87c1-299400c8804a 1073741824" returned: 0 in 0.737s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:56:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e85b060a-973f-4054-87c1-299400c8804a {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:56:39 devstack sudo[94206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e85b060a-973f-4054-87c1-299400c8804a Sep 21 11:56:39 devstack sudo[94206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:56:40 devstack sudo[94206]: pam_unix(sudo:session): session closed for user root Sep 21 11:56:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e85b060a-973f-4054-87c1-299400c8804a" returned: 0 in 0.483s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:56:40 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:56:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:56:40 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6eb1e03-35a4-4a16-9eac-43625ede679d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e85b060a-973f-4054-87c1-299400c8804a', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:40 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c05c17c-acde-4840-a482-dea1fe77732f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:40 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Volume volume-e85b060a-973f-4054-87c1-299400c8804a (e85b060a-973f-4054-87c1-299400c8804a): created successfully Sep 21 11:56:40 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c05c17c-acde-4840-a482-dea1fe77732f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:40 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Flow 'volume_create_manager' (a502e9e6-c9c2-4903-b6ec-6830b1164fe1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:56:40 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-517ef1b8-0166-43e0-a664-3aaa2fbe7e3a tempest-VolumesMetadataTest-267793751 None] Created volume successfully. Sep 21 11:56:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-96663cff-a97a-41d2-a579-c74d89875c5f tempest-VolumesMetadataTest-267793751 None] Acquiring lock "cinder-e85b060a-973f-4054-87c1-299400c8804a-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:56:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-96663cff-a97a-41d2-a579-c74d89875c5f tempest-VolumesMetadataTest-267793751 None] Lock "cinder-e85b060a-973f-4054-87c1-299400c8804a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:56:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-96663cff-a97a-41d2-a579-c74d89875c5f tempest-VolumesMetadataTest-267793751 None] Acquiring lock "cinder-quobyte-e85b060a-973f-4054-87c1-299400c8804a" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:56:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-96663cff-a97a-41d2-a579-c74d89875c5f tempest-VolumesMetadataTest-267793751 None] Lock "cinder-quobyte-e85b060a-973f-4054-87c1-299400c8804a" acquired by "delete_volume" :: waited 0.025s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:56:42 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a7d254-e026-4d23-b45c-4a23c0f2b82e]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:56:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-96663cff-a97a-41d2-a579-c74d89875c5f tempest-VolumesMetadataTest-267793751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e85b060a-973f-4054-87c1-299400c8804a {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:56:42 devstack sudo[94226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e85b060a-973f-4054-87c1-299400c8804a Sep 21 11:56:42 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:56:42 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root Sep 21 11:56:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-96663cff-a97a-41d2-a579-c74d89875c5f tempest-VolumesMetadataTest-267793751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e85b060a-973f-4054-87c1-299400c8804a" returned: 0 in 0.477s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:56:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-96663cff-a97a-41d2-a579-c74d89875c5f tempest-VolumesMetadataTest-267793751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e85b060a-973f-4054-87c1-299400c8804a {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:56:42 devstack sudo[94231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e85b060a-973f-4054-87c1-299400c8804a Sep 21 11:56:42 devstack sudo[94231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:56:43 devstack sudo[94231]: pam_unix(sudo:session): session closed for user root Sep 21 11:56:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-96663cff-a97a-41d2-a579-c74d89875c5f tempest-VolumesMetadataTest-267793751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e85b060a-973f-4054-87c1-299400c8804a" returned: 0 in 0.440s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:56:43 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-96663cff-a97a-41d2-a579-c74d89875c5f tempest-VolumesMetadataTest-267793751 None] Lock "cinder-quobyte-e85b060a-973f-4054-87c1-299400c8804a" released by "delete_volume" :: held 0.972s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:56:43 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-96663cff-a97a-41d2-a579-c74d89875c5f tempest-VolumesMetadataTest-267793751 None] Created reservations ['73dcae75-aec5-46ea-a533-97eae873c1c4', 'acea5825-6080-4448-8480-6de79c4729ed', 'a1dcc249-2c82-477f-8a8c-828f15c0f756', 'b195097a-30a9-4540-9f81-fc3084f22c49'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:56:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-96663cff-a97a-41d2-a579-c74d89875c5f tempest-VolumesMetadataTest-267793751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:56:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-96663cff-a97a-41d2-a579-c74d89875c5f tempest-VolumesMetadataTest-267793751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:56:43 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-96663cff-a97a-41d2-a579-c74d89875c5f tempest-VolumesMetadataTest-267793751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:56:43 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-96663cff-a97a-41d2-a579-c74d89875c5f tempest-VolumesMetadataTest-267793751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:56:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-96663cff-a97a-41d2-a579-c74d89875c5f tempest-VolumesMetadataTest-267793751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:56:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-96663cff-a97a-41d2-a579-c74d89875c5f tempest-VolumesMetadataTest-267793751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:56:43 devstack sudo[94234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:56:43 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:56:43 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root Sep 21 11:56:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-96663cff-a97a-41d2-a579-c74d89875c5f tempest-VolumesMetadataTest-267793751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.350s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:56:43 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-96663cff-a97a-41d2-a579-c74d89875c5f tempest-VolumesMetadataTest-267793751 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:56:43 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-96663cff-a97a-41d2-a579-c74d89875c5f tempest-VolumesMetadataTest-267793751 None] Deleted volume successfully. Sep 21 11:56:43 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-96663cff-a97a-41d2-a579-c74d89875c5f tempest-VolumesMetadataTest-267793751 None] Lock "cinder-e85b060a-973f-4054-87c1-299400c8804a-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:56:51 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:56:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Flow 'volume_create_manager' (d1e42c5d-c85c-4327-9061-f9ea0d226c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:56:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff82b19-da52-44bd-b94d-aee5f53f13c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff82b19-da52-44bd-b94d-aee5f53f13c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1991581796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=896027d7-ad4f-4daa-9730-d2d7eb75a8df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5916a05cbe29446d923fbec1b07cf3d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:56:52Z,use_quota=True,user_id='557f21d5865e49a6954886a0819d35fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e04b03a7-988f-47ab-b068-4b6127740369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e04b03a7-988f-47ab-b068-4b6127740369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (369ec8ec-6467-436e-9df6-28f5a14caa6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (369ec8ec-6467-436e-9df6-28f5a14caa6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '896027d7-ad4f-4daa-9730-d2d7eb75a8df', 'volume_name': 'volume-896027d7-ad4f-4daa-9730-d2d7eb75a8df', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2cb3142-d8af-4575-b6bb-a31d251e0b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2cb3142-d8af-4575-b6bb-a31d251e0b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dcaf25d-dcb1-424c-b508-934577e784db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:52 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Volume 896027d7-ad4f-4daa-9730-d2d7eb75a8df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-896027d7-ad4f-4daa-9730-d2d7eb75a8df', 'volume_size': 1} Sep 21 11:56:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:56:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:56:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1991581796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=896027d7-ad4f-4daa-9730-d2d7eb75a8df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5916a05cbe29446d923fbec1b07cf3d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:56:52Z,use_quota=True,user_id='557f21d5865e49a6954886a0819d35fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:56:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Creating volume 896027d7-ad4f-4daa-9730-d2d7eb75a8df {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:56:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:56:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:56:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:56:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:56:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:56:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:56:52 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:56:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-896027d7-ad4f-4daa-9730-d2d7eb75a8df 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:56:52 devstack sudo[94420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-896027d7-ad4f-4daa-9730-d2d7eb75a8df 1073741824 Sep 21 11:56:52 devstack sudo[94420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:56:53 devstack sudo[94420]: pam_unix(sudo:session): session closed for user root Sep 21 11:56:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-896027d7-ad4f-4daa-9730-d2d7eb75a8df 1073741824" returned: 0 in 1.279s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:56:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-896027d7-ad4f-4daa-9730-d2d7eb75a8df {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:56:53 devstack sudo[94427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-896027d7-ad4f-4daa-9730-d2d7eb75a8df Sep 21 11:56:53 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:56:54 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root Sep 21 11:56:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-896027d7-ad4f-4daa-9730-d2d7eb75a8df" returned: 0 in 0.813s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:56:54 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] <== create_volume: return (2233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:56:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.247s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:56:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dcaf25d-dcb1-424c-b508-934577e784db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-896027d7-ad4f-4daa-9730-d2d7eb75a8df', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15278c65-ca61-4fa7-892f-7ae060363d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:54 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Volume volume-896027d7-ad4f-4daa-9730-d2d7eb75a8df (896027d7-ad4f-4daa-9730-d2d7eb75a8df): created successfully Sep 21 11:56:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15278c65-ca61-4fa7-892f-7ae060363d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Flow 'volume_create_manager' (d1e42c5d-c85c-4327-9061-f9ea0d226c24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:56:54 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-4e367dc3-ef94-4c6f-a3e1-e432dd689732 tempest-VolumesListAdminTestJSON-1895919357 None] Created volume successfully. Sep 21 11:56:56 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:56:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Flow 'volume_create_manager' (8c4597b3-6033-4cf8-96b9-e30ec439b417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:56:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4736c3c9-32ae-4dbc-bedd-7a7b4db3c0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4736c3c9-32ae-4dbc-bedd-7a7b4db3c0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-434880642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0ee7ed1-00ba-44e4-8f0d-5622e9c953ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5916a05cbe29446d923fbec1b07cf3d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:56:57Z,use_quota=True,user_id='557f21d5865e49a6954886a0819d35fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1fd3ac7-a092-4cd6-9b87-671bc5e29f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1fd3ac7-a092-4cd6-9b87-671bc5e29f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13efefbf-cece-407c-b268-fb89d7eee810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13efefbf-cece-407c-b268-fb89d7eee810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0ee7ed1-00ba-44e4-8f0d-5622e9c953ce', 'volume_name': 'volume-b0ee7ed1-00ba-44e4-8f0d-5622e9c953ce', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6706255-2ab4-4f22-9d97-63554fc6d4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6706255-2ab4-4f22-9d97-63554fc6d4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9357b2d2-be30-4084-aaf2-346a125ea8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:56 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Volume b0ee7ed1-00ba-44e4-8f0d-5622e9c953ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0ee7ed1-00ba-44e4-8f0d-5622e9c953ce', 'volume_size': 1} Sep 21 11:56:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:56:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:56:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-434880642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0ee7ed1-00ba-44e4-8f0d-5622e9c953ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5916a05cbe29446d923fbec1b07cf3d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:56:57Z,use_quota=True,user_id='557f21d5865e49a6954886a0819d35fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:56:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Creating volume b0ee7ed1-00ba-44e4-8f0d-5622e9c953ce {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:56:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:56:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:56:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:56:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:56:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:56:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:56:56 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:56:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b0ee7ed1-00ba-44e4-8f0d-5622e9c953ce 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:56:56 devstack sudo[94443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b0ee7ed1-00ba-44e4-8f0d-5622e9c953ce 1073741824 Sep 21 11:56:56 devstack sudo[94443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:56:58 devstack sudo[94443]: pam_unix(sudo:session): session closed for user root Sep 21 11:56:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b0ee7ed1-00ba-44e4-8f0d-5622e9c953ce 1073741824" returned: 0 in 1.363s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:56:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b0ee7ed1-00ba-44e4-8f0d-5622e9c953ce {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:56:58 devstack sudo[94529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b0ee7ed1-00ba-44e4-8f0d-5622e9c953ce Sep 21 11:56:58 devstack sudo[94529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:56:59 devstack sudo[94529]: pam_unix(sudo:session): session closed for user root Sep 21 11:56:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b0ee7ed1-00ba-44e4-8f0d-5622e9c953ce" returned: 0 in 0.767s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:56:59 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] <== create_volume: return (2326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:56:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.335s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:56:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9357b2d2-be30-4084-aaf2-346a125ea8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0ee7ed1-00ba-44e4-8f0d-5622e9c953ce', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce2dc83-e269-4a3b-bd91-888caca7ada7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:56:59 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Volume volume-b0ee7ed1-00ba-44e4-8f0d-5622e9c953ce (b0ee7ed1-00ba-44e4-8f0d-5622e9c953ce): created successfully Sep 21 11:56:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce2dc83-e269-4a3b-bd91-888caca7ada7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:56:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Flow 'volume_create_manager' (8c4597b3-6033-4cf8-96b9-e30ec439b417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:56:59 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-4695c072-2036-4b23-a204-e3ececf099f2 tempest-VolumesListAdminTestJSON-1895919357 None] Created volume successfully. Sep 21 11:57:01 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:57:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Flow 'volume_create_manager' (cb86e74d-feea-4102-a3af-62d2ade794eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:57:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64092696-97c3-45ec-91a2-c1442be513d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64092696-97c3-45ec-91a2-c1442be513d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-526304672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70fd4443-83d9-4a4d-97e6-75d036d96ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5916a05cbe29446d923fbec1b07cf3d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:57:02Z,use_quota=True,user_id='557f21d5865e49a6954886a0819d35fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86cd00ba-a527-4ada-a3ba-c5d0f8b36747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86cd00ba-a527-4ada-a3ba-c5d0f8b36747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa940f2-1b1c-4928-8fd7-41028a547f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa940f2-1b1c-4928-8fd7-41028a547f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70fd4443-83d9-4a4d-97e6-75d036d96ade', 'volume_name': 'volume-70fd4443-83d9-4a4d-97e6-75d036d96ade', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db5b048-a101-4007-aaa6-b280ff8d3000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db5b048-a101-4007-aaa6-b280ff8d3000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3234709a-c75d-4f7d-9f3c-62136d23841b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:01 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Volume 70fd4443-83d9-4a4d-97e6-75d036d96ade: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70fd4443-83d9-4a4d-97e6-75d036d96ade', 'volume_size': 1} Sep 21 11:57:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:57:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:57:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-526304672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70fd4443-83d9-4a4d-97e6-75d036d96ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5916a05cbe29446d923fbec1b07cf3d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:57:02Z,use_quota=True,user_id='557f21d5865e49a6954886a0819d35fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:57:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Creating volume 70fd4443-83d9-4a4d-97e6-75d036d96ade {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:57:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:57:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:57:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:57:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:57:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:57:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:57:01 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:57:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-70fd4443-83d9-4a4d-97e6-75d036d96ade 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:01 devstack sudo[94576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-70fd4443-83d9-4a4d-97e6-75d036d96ade 1073741824 Sep 21 11:57:01 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:03 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-70fd4443-83d9-4a4d-97e6-75d036d96ade 1073741824" returned: 0 in 1.144s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-70fd4443-83d9-4a4d-97e6-75d036d96ade {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:03 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-70fd4443-83d9-4a4d-97e6-75d036d96ade Sep 21 11:57:03 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:03 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:57:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Flow 'volume_create_manager' (b4a097f3-2380-4fb6-95b0-32af69711dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:57:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8f4435-0b50-4c8e-b77b-457280826d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc8f4435-0b50-4c8e-b77b-457280826d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2033597519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5d4c86-c61c-42f6-805f-3a79841593b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e87479c3424489973947bb3c274af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:57:03Z,use_quota=True,user_id='ba1502fa48fa42aa8b2dea8348c548b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40d6a7c-1dbe-4a85-b597-c26505a5200b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40d6a7c-1dbe-4a85-b597-c26505a5200b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a84a92-05f3-4b93-8f47-4a6191c15781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a84a92-05f3-4b93-8f47-4a6191c15781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f5d4c86-c61c-42f6-805f-3a79841593b3', 'volume_name': 'volume-4f5d4c86-c61c-42f6-805f-3a79841593b3', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5db38ec-27b7-4b56-adc0-f585641f6bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5db38ec-27b7-4b56-adc0-f585641f6bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b4ab84-3a90-4b14-89e1-a947f97688f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:03 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Volume 4f5d4c86-c61c-42f6-805f-3a79841593b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f5d4c86-c61c-42f6-805f-3a79841593b3', 'volume_size': 1} Sep 21 11:57:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:57:03 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 11:57:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:57:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:57:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:57:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:57:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:57:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:03 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:57:03 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:03 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-70fd4443-83d9-4a4d-97e6-75d036d96ade" returned: 0 in 0.814s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] <== create_volume: return (2083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:57:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.088s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:57:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.342s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:57:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2033597519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5d4c86-c61c-42f6-805f-3a79841593b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40e87479c3424489973947bb3c274af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:57:03Z,use_quota=True,user_id='ba1502fa48fa42aa8b2dea8348c548b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:57:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Creating volume 4f5d4c86-c61c-42f6-805f-3a79841593b3 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:57:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:57:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:57:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:57:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:57:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:57:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:57:04 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:57:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f5d4c86-c61c-42f6-805f-3a79841593b3 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:04 devstack sudo[94587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f5d4c86-c61c-42f6-805f-3a79841593b3 1073741824 Sep 21 11:57:04 devstack sudo[94587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3234709a-c75d-4f7d-9f3c-62136d23841b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70fd4443-83d9-4a4d-97e6-75d036d96ade', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe73f5ed-d5ef-40b9-9832-c9b443ea1644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:04 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Volume volume-70fd4443-83d9-4a4d-97e6-75d036d96ade (70fd4443-83d9-4a4d-97e6-75d036d96ade): created successfully Sep 21 11:57:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe73f5ed-d5ef-40b9-9832-c9b443ea1644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Flow 'volume_create_manager' (cb86e74d-feea-4102-a3af-62d2ade794eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:57:04 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-e46b7611-1fc9-4285-a5a7-8b988cc3e24f tempest-VolumesListAdminTestJSON-1895919357 None] Created volume successfully. Sep 21 11:57:04 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.665s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:04 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:57:04 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 11:57:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread count: 28 {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 11:57:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread info: [<_MainThread(MainThread, started 132841976594560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 11:57:05 devstack sudo[94587]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f5d4c86-c61c-42f6-805f-3a79841593b3 1073741824" returned: 0 in 0.959s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f5d4c86-c61c-42f6-805f-3a79841593b3 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:05 devstack sudo[94594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f5d4c86-c61c-42f6-805f-3a79841593b3 Sep 21 11:57:05 devstack sudo[94594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:05 devstack sudo[94594]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f5d4c86-c61c-42f6-805f-3a79841593b3" returned: 0 in 0.652s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:05 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:57:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:57:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b4ab84-3a90-4b14-89e1-a947f97688f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f5d4c86-c61c-42f6-805f-3a79841593b3', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6719a007-06e4-46d6-a465-a8f49af4769a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:05 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Volume volume-4f5d4c86-c61c-42f6-805f-3a79841593b3 (4f5d4c86-c61c-42f6-805f-3a79841593b3): created successfully Sep 21 11:57:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6719a007-06e4-46d6-a465-a8f49af4769a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Flow 'volume_create_manager' (b4a097f3-2380-4fb6-95b0-32af69711dc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:57:05 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-0285fb96-b12e-4f0b-ba60-295619fe3796 tempest-ServerRescueNegativeTestJSON-267650043 None] Created volume successfully. Sep 21 11:57:07 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:57:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Flow 'volume_create_manager' (031f572a-7a06-455b-990d-690c12456843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:57:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508ebc53-3081-48af-972b-a7bc6fdb7f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508ebc53-3081-48af-972b-a7bc6fdb7f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5d6e192-011d-47a7-9d8c-9ad25e6c32d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84265bdb56b64d5e8fa324addb27f7bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:57:07Z,use_quota=True,user_id='176c8eb6186b4bd8bcb5f742a9b11a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd730205-18f3-4e08-9481-26806e25b577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd730205-18f3-4e08-9481-26806e25b577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8595aaa2-9f06-4ed7-bb89-89846b9eb74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8595aaa2-9f06-4ed7-bb89-89846b9eb74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5d6e192-011d-47a7-9d8c-9ad25e6c32d7', 'volume_name': 'volume-d5d6e192-011d-47a7-9d8c-9ad25e6c32d7', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (343af6c0-4c9d-486a-a408-6b574530b92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (343af6c0-4c9d-486a-a408-6b574530b92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a478d7a1-5585-4837-b629-e7d45f472ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:07 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Volume d5d6e192-011d-47a7-9d8c-9ad25e6c32d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5d6e192-011d-47a7-9d8c-9ad25e6c32d7', 'volume_size': 1} Sep 21 11:57:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:57:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:57:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5d6e192-011d-47a7-9d8c-9ad25e6c32d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84265bdb56b64d5e8fa324addb27f7bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:57:07Z,use_quota=True,user_id='176c8eb6186b4bd8bcb5f742a9b11a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:57:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Creating volume d5d6e192-011d-47a7-9d8c-9ad25e6c32d7 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:57:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:57:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:57:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:57:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:57:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:57:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:57:07 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:57:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d5d6e192-011d-47a7-9d8c-9ad25e6c32d7 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:07 devstack sudo[94599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d5d6e192-011d-47a7-9d8c-9ad25e6c32d7 1073741824 Sep 21 11:57:07 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:08 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d5d6e192-011d-47a7-9d8c-9ad25e6c32d7 1073741824" returned: 0 in 1.111s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d5d6e192-011d-47a7-9d8c-9ad25e6c32d7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:08 devstack sudo[94607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d5d6e192-011d-47a7-9d8c-9ad25e6c32d7 Sep 21 11:57:08 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:09 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d5d6e192-011d-47a7-9d8c-9ad25e6c32d7" returned: 0 in 0.716s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] <== create_volume: return (1944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:57:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:57:09 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a478d7a1-5585-4837-b629-e7d45f472ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5d6e192-011d-47a7-9d8c-9ad25e6c32d7', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:09 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dfe3665-d082-46b7-8331-aaf11145d8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:09 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Volume volume-d5d6e192-011d-47a7-9d8c-9ad25e6c32d7 (d5d6e192-011d-47a7-9d8c-9ad25e6c32d7): created successfully Sep 21 11:57:09 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dfe3665-d082-46b7-8331-aaf11145d8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:09 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Flow 'volume_create_manager' (031f572a-7a06-455b-990d-690c12456843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:57:09 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-b0877e02-0841-457f-a787-cd5ac63695c8 tempest-VolumesListAdminTestJSON-1792457488 None] Created volume successfully. Sep 21 11:57:10 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-51d32082-512f-4dc5-8d98-5201d00499e0 tempest-VolumesListAdminTestJSON-1792457488 None] Acquiring lock "cinder-d5d6e192-011d-47a7-9d8c-9ad25e6c32d7-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:57:10 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-51d32082-512f-4dc5-8d98-5201d00499e0 tempest-VolumesListAdminTestJSON-1792457488 None] Lock "cinder-d5d6e192-011d-47a7-9d8c-9ad25e6c32d7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:57:10 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=39,cinder:UPDATE=43,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:57:10 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-51d32082-512f-4dc5-8d98-5201d00499e0 tempest-VolumesListAdminTestJSON-1792457488 None] Acquiring lock "cinder-quobyte-d5d6e192-011d-47a7-9d8c-9ad25e6c32d7" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:57:10 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-51d32082-512f-4dc5-8d98-5201d00499e0 tempest-VolumesListAdminTestJSON-1792457488 None] Lock "cinder-quobyte-d5d6e192-011d-47a7-9d8c-9ad25e6c32d7" acquired by "delete_volume" :: waited 0.040s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:57:10 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d25292-9f37-4059-a7f1-a8374b31dbc7]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:57:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-51d32082-512f-4dc5-8d98-5201d00499e0 tempest-VolumesListAdminTestJSON-1792457488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d5d6e192-011d-47a7-9d8c-9ad25e6c32d7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e14d2deb-f2ab-42bb-acd5-b364b6d68213 tempest-VolumesListAdminTestJSON-1895919357 None] Acquiring lock "cinder-70fd4443-83d9-4a4d-97e6-75d036d96ade-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:57:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e14d2deb-f2ab-42bb-acd5-b364b6d68213 tempest-VolumesListAdminTestJSON-1895919357 None] Lock "cinder-70fd4443-83d9-4a4d-97e6-75d036d96ade-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:57:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e14d2deb-f2ab-42bb-acd5-b364b6d68213 tempest-VolumesListAdminTestJSON-1895919357 None] Acquiring lock "cinder-quobyte-70fd4443-83d9-4a4d-97e6-75d036d96ade" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:57:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e14d2deb-f2ab-42bb-acd5-b364b6d68213 tempest-VolumesListAdminTestJSON-1895919357 None] Lock "cinder-quobyte-70fd4443-83d9-4a4d-97e6-75d036d96ade" acquired by "delete_volume" :: waited 0.019s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:57:11 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[193f7c39-64b8-40f8-929f-27aec350b5f3]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:57:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e14d2deb-f2ab-42bb-acd5-b364b6d68213 tempest-VolumesListAdminTestJSON-1895919357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-70fd4443-83d9-4a4d-97e6-75d036d96ade {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:11 devstack sudo[94623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d5d6e192-011d-47a7-9d8c-9ad25e6c32d7 Sep 21 11:57:11 devstack sudo[94623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:11 devstack sudo[94626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-70fd4443-83d9-4a4d-97e6-75d036d96ade Sep 21 11:57:11 devstack sudo[94626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:11 devstack sudo[94626]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e14d2deb-f2ab-42bb-acd5-b364b6d68213 tempest-VolumesListAdminTestJSON-1895919357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-70fd4443-83d9-4a4d-97e6-75d036d96ade" returned: 0 in 0.802s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e14d2deb-f2ab-42bb-acd5-b364b6d68213 tempest-VolumesListAdminTestJSON-1895919357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-70fd4443-83d9-4a4d-97e6-75d036d96ade {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:12 devstack sudo[94652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-70fd4443-83d9-4a4d-97e6-75d036d96ade Sep 21 11:57:12 devstack sudo[94652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:12 devstack sudo[94623]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-51d32082-512f-4dc5-8d98-5201d00499e0 tempest-VolumesListAdminTestJSON-1792457488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d5d6e192-011d-47a7-9d8c-9ad25e6c32d7" returned: 0 in 1.450s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-51d32082-512f-4dc5-8d98-5201d00499e0 tempest-VolumesListAdminTestJSON-1792457488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d5d6e192-011d-47a7-9d8c-9ad25e6c32d7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:12 devstack sudo[94658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d5d6e192-011d-47a7-9d8c-9ad25e6c32d7 Sep 21 11:57:12 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:12 devstack sudo[94652]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e14d2deb-f2ab-42bb-acd5-b364b6d68213 tempest-VolumesListAdminTestJSON-1895919357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-70fd4443-83d9-4a4d-97e6-75d036d96ade" returned: 0 in 0.533s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e14d2deb-f2ab-42bb-acd5-b364b6d68213 tempest-VolumesListAdminTestJSON-1895919357 None] Lock "cinder-quobyte-70fd4443-83d9-4a4d-97e6-75d036d96ade" released by "delete_volume" :: held 1.470s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:57:12 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:UPDATE=55,cinder:SELECT=27,cinder:INSERT=11,cinder:DELETE=9 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:57:12 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-e14d2deb-f2ab-42bb-acd5-b364b6d68213 tempest-VolumesListAdminTestJSON-1895919357 None] Created reservations ['66c1c29c-d017-437a-9db9-00640b8262f0', '3556ee62-2f76-48c8-aa93-c83d407d8f0f', '1eaaed36-33d6-47ac-80d6-ba47b92423e5', '549d0822-a3cd-48fa-8f4e-e21dcf3b8bb5'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:57:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e14d2deb-f2ab-42bb-acd5-b364b6d68213 tempest-VolumesListAdminTestJSON-1895919357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:57:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e14d2deb-f2ab-42bb-acd5-b364b6d68213 tempest-VolumesListAdminTestJSON-1895919357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:57:12 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e14d2deb-f2ab-42bb-acd5-b364b6d68213 tempest-VolumesListAdminTestJSON-1895919357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:57:12 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e14d2deb-f2ab-42bb-acd5-b364b6d68213 tempest-VolumesListAdminTestJSON-1895919357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:57:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e14d2deb-f2ab-42bb-acd5-b364b6d68213 tempest-VolumesListAdminTestJSON-1895919357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:57:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e14d2deb-f2ab-42bb-acd5-b364b6d68213 tempest-VolumesListAdminTestJSON-1895919357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:12 devstack sudo[94662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:57:12 devstack sudo[94662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:13 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-51d32082-512f-4dc5-8d98-5201d00499e0 tempest-VolumesListAdminTestJSON-1792457488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d5d6e192-011d-47a7-9d8c-9ad25e6c32d7" returned: 0 in 0.748s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:13 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-51d32082-512f-4dc5-8d98-5201d00499e0 tempest-VolumesListAdminTestJSON-1792457488 None] Lock "cinder-quobyte-d5d6e192-011d-47a7-9d8c-9ad25e6c32d7" released by "delete_volume" :: held 2.311s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:57:13 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-51d32082-512f-4dc5-8d98-5201d00499e0 tempest-VolumesListAdminTestJSON-1792457488 None] Created reservations ['387f8ee6-2af7-4f20-a4c4-b780a687b398', 'd7943ba2-785a-4c4c-bae6-5b25dd61aebf', '77244a6c-f65b-449b-8f9a-ab807a0dcc51', 'cfe1924e-e2d0-490b-b6e4-85c3cbaf5579'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:57:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-51d32082-512f-4dc5-8d98-5201d00499e0 tempest-VolumesListAdminTestJSON-1792457488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:57:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-51d32082-512f-4dc5-8d98-5201d00499e0 tempest-VolumesListAdminTestJSON-1792457488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:57:13 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-51d32082-512f-4dc5-8d98-5201d00499e0 tempest-VolumesListAdminTestJSON-1792457488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:57:13 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-51d32082-512f-4dc5-8d98-5201d00499e0 tempest-VolumesListAdminTestJSON-1792457488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:57:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-51d32082-512f-4dc5-8d98-5201d00499e0 tempest-VolumesListAdminTestJSON-1792457488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:57:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-51d32082-512f-4dc5-8d98-5201d00499e0 tempest-VolumesListAdminTestJSON-1792457488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:13 devstack sudo[94664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:57:13 devstack sudo[94664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:13 devstack sudo[94662]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e14d2deb-f2ab-42bb-acd5-b364b6d68213 tempest-VolumesListAdminTestJSON-1895919357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.762s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:13 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-e14d2deb-f2ab-42bb-acd5-b364b6d68213 tempest-VolumesListAdminTestJSON-1895919357 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:57:13 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-e14d2deb-f2ab-42bb-acd5-b364b6d68213 tempest-VolumesListAdminTestJSON-1895919357 None] Deleted volume successfully. Sep 21 11:57:13 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e14d2deb-f2ab-42bb-acd5-b364b6d68213 tempest-VolumesListAdminTestJSON-1895919357 None] Lock "cinder-70fd4443-83d9-4a4d-97e6-75d036d96ade-delete_volume" released by "delete_volume" :: held 2.770s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:57:14 devstack sudo[94664]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0dd00ab0-bf11-4df7-8ad1-5749e6895770 tempest-VolumesListAdminTestJSON-1895919357 None] Acquiring lock "cinder-b0ee7ed1-00ba-44e4-8f0d-5622e9c953ce-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:57:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-51d32082-512f-4dc5-8d98-5201d00499e0 tempest-VolumesListAdminTestJSON-1792457488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.748s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:14 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-51d32082-512f-4dc5-8d98-5201d00499e0 tempest-VolumesListAdminTestJSON-1792457488 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:57:14 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-51d32082-512f-4dc5-8d98-5201d00499e0 tempest-VolumesListAdminTestJSON-1792457488 None] Deleted volume successfully. Sep 21 11:57:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0dd00ab0-bf11-4df7-8ad1-5749e6895770 tempest-VolumesListAdminTestJSON-1895919357 None] Lock "cinder-b0ee7ed1-00ba-44e4-8f0d-5622e9c953ce-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:57:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-51d32082-512f-4dc5-8d98-5201d00499e0 tempest-VolumesListAdminTestJSON-1792457488 None] Lock "cinder-d5d6e192-011d-47a7-9d8c-9ad25e6c32d7-delete_volume" released by "delete_volume" :: held 3.512s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:57:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0dd00ab0-bf11-4df7-8ad1-5749e6895770 tempest-VolumesListAdminTestJSON-1895919357 None] Acquiring lock "cinder-quobyte-b0ee7ed1-00ba-44e4-8f0d-5622e9c953ce" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:57:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0dd00ab0-bf11-4df7-8ad1-5749e6895770 tempest-VolumesListAdminTestJSON-1895919357 None] Lock "cinder-quobyte-b0ee7ed1-00ba-44e4-8f0d-5622e9c953ce" acquired by "delete_volume" :: waited 0.034s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:57:14 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[06889d6b-c501-41ed-80f0-1b70106e3b7a]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:57:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0dd00ab0-bf11-4df7-8ad1-5749e6895770 tempest-VolumesListAdminTestJSON-1895919357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b0ee7ed1-00ba-44e4-8f0d-5622e9c953ce {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:14 devstack sudo[94669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b0ee7ed1-00ba-44e4-8f0d-5622e9c953ce Sep 21 11:57:14 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:15 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0dd00ab0-bf11-4df7-8ad1-5749e6895770 tempest-VolumesListAdminTestJSON-1895919357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b0ee7ed1-00ba-44e4-8f0d-5622e9c953ce" returned: 0 in 0.931s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0dd00ab0-bf11-4df7-8ad1-5749e6895770 tempest-VolumesListAdminTestJSON-1895919357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b0ee7ed1-00ba-44e4-8f0d-5622e9c953ce {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:15 devstack sudo[94675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b0ee7ed1-00ba-44e4-8f0d-5622e9c953ce Sep 21 11:57:15 devstack sudo[94675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:15 devstack sudo[94675]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0dd00ab0-bf11-4df7-8ad1-5749e6895770 tempest-VolumesListAdminTestJSON-1895919357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b0ee7ed1-00ba-44e4-8f0d-5622e9c953ce" returned: 0 in 0.663s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:15 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0dd00ab0-bf11-4df7-8ad1-5749e6895770 tempest-VolumesListAdminTestJSON-1895919357 None] Lock "cinder-quobyte-b0ee7ed1-00ba-44e4-8f0d-5622e9c953ce" released by "delete_volume" :: held 1.709s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:57:16 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-0dd00ab0-bf11-4df7-8ad1-5749e6895770 tempest-VolumesListAdminTestJSON-1895919357 None] Created reservations ['e1d3c678-7830-46e2-a459-6e49d5b43220', 'e18ff01d-c51b-4a05-9bef-27bd94cbc555', '25efbc42-574c-4d32-add4-7cf26fbd8825', '20687680-5aa3-4d38-ab48-0414208a3082'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:57:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0dd00ab0-bf11-4df7-8ad1-5749e6895770 tempest-VolumesListAdminTestJSON-1895919357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:57:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0dd00ab0-bf11-4df7-8ad1-5749e6895770 tempest-VolumesListAdminTestJSON-1895919357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:57:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0dd00ab0-bf11-4df7-8ad1-5749e6895770 tempest-VolumesListAdminTestJSON-1895919357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:57:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0dd00ab0-bf11-4df7-8ad1-5749e6895770 tempest-VolumesListAdminTestJSON-1895919357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:57:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0dd00ab0-bf11-4df7-8ad1-5749e6895770 tempest-VolumesListAdminTestJSON-1895919357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:57:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0dd00ab0-bf11-4df7-8ad1-5749e6895770 tempest-VolumesListAdminTestJSON-1895919357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:16 devstack sudo[94679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:57:16 devstack sudo[94679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:16 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2bf79584-3f62-4e88-8526-610757046bf4 tempest-VolumesListAdminTestJSON-1895919357 None] Acquiring lock "cinder-896027d7-ad4f-4daa-9730-d2d7eb75a8df-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:57:16 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2bf79584-3f62-4e88-8526-610757046bf4 tempest-VolumesListAdminTestJSON-1895919357 None] Lock "cinder-896027d7-ad4f-4daa-9730-d2d7eb75a8df-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:57:16 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2bf79584-3f62-4e88-8526-610757046bf4 tempest-VolumesListAdminTestJSON-1895919357 None] Acquiring lock "cinder-quobyte-896027d7-ad4f-4daa-9730-d2d7eb75a8df" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:57:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2bf79584-3f62-4e88-8526-610757046bf4 tempest-VolumesListAdminTestJSON-1895919357 None] Lock "cinder-quobyte-896027d7-ad4f-4daa-9730-d2d7eb75a8df" acquired by "delete_volume" :: waited 0.071s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:57:17 devstack sudo[94679]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:17 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e171d5-351b-4762-9baf-bd0c4d4c678b]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:57:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2bf79584-3f62-4e88-8526-610757046bf4 tempest-VolumesListAdminTestJSON-1895919357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-896027d7-ad4f-4daa-9730-d2d7eb75a8df {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0dd00ab0-bf11-4df7-8ad1-5749e6895770 tempest-VolumesListAdminTestJSON-1895919357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.840s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:17 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-0dd00ab0-bf11-4df7-8ad1-5749e6895770 tempest-VolumesListAdminTestJSON-1895919357 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:57:17 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-0dd00ab0-bf11-4df7-8ad1-5749e6895770 tempest-VolumesListAdminTestJSON-1895919357 None] Deleted volume successfully. Sep 21 11:57:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0dd00ab0-bf11-4df7-8ad1-5749e6895770 tempest-VolumesListAdminTestJSON-1895919357 None] Lock "cinder-b0ee7ed1-00ba-44e4-8f0d-5622e9c953ce-delete_volume" released by "delete_volume" :: held 3.129s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:57:17 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-896027d7-ad4f-4daa-9730-d2d7eb75a8df Sep 21 11:57:17 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:18 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2bf79584-3f62-4e88-8526-610757046bf4 tempest-VolumesListAdminTestJSON-1895919357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-896027d7-ad4f-4daa-9730-d2d7eb75a8df" returned: 0 in 1.020s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2bf79584-3f62-4e88-8526-610757046bf4 tempest-VolumesListAdminTestJSON-1895919357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-896027d7-ad4f-4daa-9730-d2d7eb75a8df {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:18 devstack sudo[94765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-896027d7-ad4f-4daa-9730-d2d7eb75a8df Sep 21 11:57:18 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:18 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2bf79584-3f62-4e88-8526-610757046bf4 tempest-VolumesListAdminTestJSON-1895919357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-896027d7-ad4f-4daa-9730-d2d7eb75a8df" returned: 0 in 0.342s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:18 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2bf79584-3f62-4e88-8526-610757046bf4 tempest-VolumesListAdminTestJSON-1895919357 None] Lock "cinder-quobyte-896027d7-ad4f-4daa-9730-d2d7eb75a8df" released by "delete_volume" :: held 1.484s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:57:18 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-2bf79584-3f62-4e88-8526-610757046bf4 tempest-VolumesListAdminTestJSON-1895919357 None] Created reservations ['d47e2418-dec1-4d98-9b43-257a78f3e6b9', 'd1edab95-9d17-40c2-a5fe-e7c3c327c4d4', 'a205222a-3c84-4867-a8f4-b3f4f132e187', '20f2549e-aad5-450d-b242-ab461f01073a'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:57:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2bf79584-3f62-4e88-8526-610757046bf4 tempest-VolumesListAdminTestJSON-1895919357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:57:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2bf79584-3f62-4e88-8526-610757046bf4 tempest-VolumesListAdminTestJSON-1895919357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:57:18 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2bf79584-3f62-4e88-8526-610757046bf4 tempest-VolumesListAdminTestJSON-1895919357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:57:18 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2bf79584-3f62-4e88-8526-610757046bf4 tempest-VolumesListAdminTestJSON-1895919357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:57:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2bf79584-3f62-4e88-8526-610757046bf4 tempest-VolumesListAdminTestJSON-1895919357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:57:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2bf79584-3f62-4e88-8526-610757046bf4 tempest-VolumesListAdminTestJSON-1895919357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:18 devstack sudo[94789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:57:18 devstack sudo[94789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:18 devstack sudo[94789]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2bf79584-3f62-4e88-8526-610757046bf4 tempest-VolumesListAdminTestJSON-1895919357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.303s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:18 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-2bf79584-3f62-4e88-8526-610757046bf4 tempest-VolumesListAdminTestJSON-1895919357 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:57:18 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-2bf79584-3f62-4e88-8526-610757046bf4 tempest-VolumesListAdminTestJSON-1895919357 None] Deleted volume successfully. Sep 21 11:57:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2bf79584-3f62-4e88-8526-610757046bf4 tempest-VolumesListAdminTestJSON-1895919357 None] Lock "cinder-896027d7-ad4f-4daa-9730-d2d7eb75a8df-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:57:20 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2cc4b45e-195b-47cd-b203-495e508a5238 tempest-ServerRescueNegativeTestJSON-267650043 None] Acquiring lock "cinder-4f5d4c86-c61c-42f6-805f-3a79841593b3-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:57:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2cc4b45e-195b-47cd-b203-495e508a5238 tempest-ServerRescueNegativeTestJSON-267650043 None] Lock "cinder-4f5d4c86-c61c-42f6-805f-3a79841593b3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:57:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2cc4b45e-195b-47cd-b203-495e508a5238 tempest-ServerRescueNegativeTestJSON-267650043 None] Acquiring lock "cinder-quobyte-4f5d4c86-c61c-42f6-805f-3a79841593b3" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:57:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2cc4b45e-195b-47cd-b203-495e508a5238 tempest-ServerRescueNegativeTestJSON-267650043 None] Lock "cinder-quobyte-4f5d4c86-c61c-42f6-805f-3a79841593b3" acquired by "delete_volume" :: waited 0.034s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:57:21 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97f413f-e947-4b81-b97a-2f7e54626170]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:57:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2cc4b45e-195b-47cd-b203-495e508a5238 tempest-ServerRescueNegativeTestJSON-267650043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f5d4c86-c61c-42f6-805f-3a79841593b3 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:21 devstack sudo[94794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f5d4c86-c61c-42f6-805f-3a79841593b3 Sep 21 11:57:21 devstack sudo[94794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:21 devstack sudo[94794]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2cc4b45e-195b-47cd-b203-495e508a5238 tempest-ServerRescueNegativeTestJSON-267650043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f5d4c86-c61c-42f6-805f-3a79841593b3" returned: 0 in 0.576s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2cc4b45e-195b-47cd-b203-495e508a5238 tempest-ServerRescueNegativeTestJSON-267650043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f5d4c86-c61c-42f6-805f-3a79841593b3 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:21 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f5d4c86-c61c-42f6-805f-3a79841593b3 Sep 21 11:57:21 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:22 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2cc4b45e-195b-47cd-b203-495e508a5238 tempest-ServerRescueNegativeTestJSON-267650043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f5d4c86-c61c-42f6-805f-3a79841593b3" returned: 0 in 0.356s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2cc4b45e-195b-47cd-b203-495e508a5238 tempest-ServerRescueNegativeTestJSON-267650043 None] Lock "cinder-quobyte-4f5d4c86-c61c-42f6-805f-3a79841593b3" released by "delete_volume" :: held 1.027s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Flow 'volume_create_manager' (ed417bb4-98dd-4821-bcc5-b3cfa3884b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7104b3d-4bf0-4342-94d8-f3e0c3280f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7104b3d-4bf0-4342-94d8-f3e0c3280f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1126847155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a55e8d08-4354-4179-9609-260e26681632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34bddb37f02f4d5393beef976564d31b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:57:22Z,use_quota=True,user_id='08457d6831ae4e31a38df8cf4edc8562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c5dd246-8f9e-4afd-93f5-d26030fe4f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c5dd246-8f9e-4afd-93f5-d26030fe4f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd33a24b-3c19-425f-bc80-ce67388683b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd33a24b-3c19-425f-bc80-ce67388683b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a55e8d08-4354-4179-9609-260e26681632', 'volume_name': 'volume-a55e8d08-4354-4179-9609-260e26681632', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88dce051-0653-47f7-801f-341202ed4c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88dce051-0653-47f7-801f-341202ed4c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad116451-4015-4669-9e6c-102625f36668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:22 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Volume a55e8d08-4354-4179-9609-260e26681632: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a55e8d08-4354-4179-9609-260e26681632', 'volume_size': 1} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1126847155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a55e8d08-4354-4179-9609-260e26681632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34bddb37f02f4d5393beef976564d31b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:57:22Z,use_quota=True,user_id='08457d6831ae4e31a38df8cf4edc8562',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Creating volume a55e8d08-4354-4179-9609-260e26681632 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:57:22 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:22 devstack sudo[94802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632 1073741824 Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-2cc4b45e-195b-47cd-b203-495e508a5238 tempest-ServerRescueNegativeTestJSON-267650043 None] Created reservations ['51936184-ef62-4743-aacf-c9656cd43f70', 'e4574925-668c-4dd5-9c2e-6e9cc3b34c84', 'b18fb701-2d9d-4e39-84f4-a25b5aac0ed7', 'cec0387d-9fc3-4881-95c3-bb8477df125f'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:57:22 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2cc4b45e-195b-47cd-b203-495e508a5238 tempest-ServerRescueNegativeTestJSON-267650043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2cc4b45e-195b-47cd-b203-495e508a5238 tempest-ServerRescueNegativeTestJSON-267650043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2cc4b45e-195b-47cd-b203-495e508a5238 tempest-ServerRescueNegativeTestJSON-267650043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2cc4b45e-195b-47cd-b203-495e508a5238 tempest-ServerRescueNegativeTestJSON-267650043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2cc4b45e-195b-47cd-b203-495e508a5238 tempest-ServerRescueNegativeTestJSON-267650043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2cc4b45e-195b-47cd-b203-495e508a5238 tempest-ServerRescueNegativeTestJSON-267650043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:22 devstack sudo[94804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:57:22 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:22 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2cc4b45e-195b-47cd-b203-495e508a5238 tempest-ServerRescueNegativeTestJSON-267650043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.309s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-2cc4b45e-195b-47cd-b203-495e508a5238 tempest-ServerRescueNegativeTestJSON-267650043 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:57:22 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-2cc4b45e-195b-47cd-b203-495e508a5238 tempest-ServerRescueNegativeTestJSON-267650043 None] Deleted volume successfully. Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2cc4b45e-195b-47cd-b203-495e508a5238 tempest-ServerRescueNegativeTestJSON-267650043 None] Lock "cinder-4f5d4c86-c61c-42f6-805f-3a79841593b3-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:57:22 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632 1073741824" returned: 0 in 0.588s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:23 devstack sudo[94811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632 Sep 21 11:57:23 devstack sudo[94811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:23 devstack sudo[94811]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632" returned: 0 in 0.300s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:23 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:57:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:57:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad116451-4015-4669-9e6c-102625f36668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a55e8d08-4354-4179-9609-260e26681632', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a099a48d-0873-452a-9b08-895c3c6ef201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:23 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Volume volume-a55e8d08-4354-4179-9609-260e26681632 (a55e8d08-4354-4179-9609-260e26681632): created successfully Sep 21 11:57:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a099a48d-0873-452a-9b08-895c3c6ef201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Flow 'volume_create_manager' (ed417bb4-98dd-4821-bcc5-b3cfa3884b7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:57:23 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-8e656dcd-246a-489d-9749-01650cb74620 tempest-VolumesActionsTest-33188292 None] Created volume successfully. Sep 21 11:57:29 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:57:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Flow 'volume_create_manager' (70e32648-545d-4deb-8cd0-fb84a293f10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:57:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ad5936-23c7-43dd-bcaf-a245ce3d03ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ad5936-23c7-43dd-bcaf-a245ce3d03ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1771310588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9973cbb-59ee-431e-86f6-21a6c222b3fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c591b6fc9b943c3baf91be484a47042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:57:29Z,use_quota=True,user_id='13275be66bd7420ca97d33800442d39c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3f8ada-32c1-4c20-9a04-82aff5bc72de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3f8ada-32c1-4c20-9a04-82aff5bc72de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d20ae2a-fc03-4011-95fe-f34607f4996c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d20ae2a-fc03-4011-95fe-f34607f4996c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9973cbb-59ee-431e-86f6-21a6c222b3fe', 'volume_name': 'volume-d9973cbb-59ee-431e-86f6-21a6c222b3fe', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466b4c32-58e4-4ee5-aa98-39cc28d9ff62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466b4c32-58e4-4ee5-aa98-39cc28d9ff62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (921d58a5-1ca2-4a4c-bb27-77d3de0f92c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:29 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Volume d9973cbb-59ee-431e-86f6-21a6c222b3fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9973cbb-59ee-431e-86f6-21a6c222b3fe', 'volume_size': 1} Sep 21 11:57:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:57:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:57:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1771310588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9973cbb-59ee-431e-86f6-21a6c222b3fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c591b6fc9b943c3baf91be484a47042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:57:29Z,use_quota=True,user_id='13275be66bd7420ca97d33800442d39c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:57:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Creating volume d9973cbb-59ee-431e-86f6-21a6c222b3fe {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:57:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:57:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:57:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:57:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:57:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:57:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:57:29 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:57:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d9973cbb-59ee-431e-86f6-21a6c222b3fe 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:29 devstack sudo[94885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d9973cbb-59ee-431e-86f6-21a6c222b3fe 1073741824 Sep 21 11:57:29 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:30 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d9973cbb-59ee-431e-86f6-21a6c222b3fe 1073741824" returned: 0 in 0.662s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d9973cbb-59ee-431e-86f6-21a6c222b3fe {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:30 devstack sudo[94894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d9973cbb-59ee-431e-86f6-21a6c222b3fe Sep 21 11:57:30 devstack sudo[94894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:30 devstack sudo[94894]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d9973cbb-59ee-431e-86f6-21a6c222b3fe" returned: 0 in 0.352s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:30 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:57:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:57:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (921d58a5-1ca2-4a4c-bb27-77d3de0f92c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9973cbb-59ee-431e-86f6-21a6c222b3fe', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (539c6488-6a6a-418c-b74d-523ed5efae24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:30 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Volume volume-d9973cbb-59ee-431e-86f6-21a6c222b3fe (d9973cbb-59ee-431e-86f6-21a6c222b3fe): created successfully Sep 21 11:57:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (539c6488-6a6a-418c-b74d-523ed5efae24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Flow 'volume_create_manager' (70e32648-545d-4deb-8cd0-fb84a293f10e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:57:30 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-9e21737a-71ca-4f43-8b32-b27032ef9503 tempest-AttachVolumeTestJSON-1328565065 None] Created volume successfully. Sep 21 11:57:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-6b030b33-c5f3-4566-94f8-540009a0e717 req-fecdcb93-6f38-4dec-9487-70fd7ca1cf7f tempest-AttachVolumeTestJSON-1328565065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:57:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-6b030b33-c5f3-4566-94f8-540009a0e717 req-fecdcb93-6f38-4dec-9487-70fd7ca1cf7f tempest-AttachVolumeTestJSON-1328565065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:57:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-6b030b33-c5f3-4566-94f8-540009a0e717 req-fecdcb93-6f38-4dec-9487-70fd7ca1cf7f tempest-AttachVolumeTestJSON-1328565065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:57:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-6b030b33-c5f3-4566-94f8-540009a0e717 req-fecdcb93-6f38-4dec-9487-70fd7ca1cf7f tempest-AttachVolumeTestJSON-1328565065 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d', 'name': 'volume-d9973cbb-59ee-431e-86f6-21a6c222b3fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f5d2515d-a887-4193-b23e-f58e205342e0', 'enforce_multipath': True} {{(pid=86366) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 11:57:33 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-6b030b33-c5f3-4566-94f8-540009a0e717 req-fecdcb93-6f38-4dec-9487-70fd7ca1cf7f tempest-AttachVolumeTestJSON-1328565065 None] attachment_update completed successfully. Sep 21 11:57:35 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:57:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Flow 'volume_create_manager' (5005aebb-820d-4253-b516-aab4b76188a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:57:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f03736-e8f4-47c5-b6d0-63c40a44d024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f03736-e8f4-47c5-b6d0-63c40a44d024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-998616117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a364e8-7975-46d3-a21f-4f338e1f8423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb6589e2d2d94db1b852a669541e805e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:57:35Z,use_quota=True,user_id='0d48ac6de85c4d1cb372db3c2f37c87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d66ab6-d750-4c6f-bb67-059c42dace44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d66ab6-d750-4c6f-bb67-059c42dace44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa229f13-2664-4d7c-9450-af9bf1422124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:35 devstack cinder-volume[86366]: DEBUG cinder.image.glance [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Creating Keystone auth plugin from conf {{(pid=86366) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 21 11:57:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa229f13-2664-4d7c-9450-af9bf1422124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f8a364e8-7975-46d3-a21f-4f338e1f8423', 'volume_name': 'volume-f8a364e8-7975-46d3-a21f-4f338e1f8423', 'volume_size': 1, 'image_id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6c23462c1d34d9a9d8fbc8d8872d421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'created_at': datetime.datetime(2026, 9, 21, 9, 44, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 9, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df064c67-783a-46a8-8141-f6fc668c7162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df064c67-783a-46a8-8141-f6fc668c7162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc0d3c9-3280-4a00-8667-6247c33d8cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:35 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Volume f8a364e8-7975-46d3-a21f-4f338e1f8423: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f8a364e8-7975-46d3-a21f-4f338e1f8423', 'volume_size': 1, 'image_id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6c23462c1d34d9a9d8fbc8d8872d421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'created_at': datetime.datetime(2026, 9, 21, 9, 44, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 9, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 21 11:57:35 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Trying to clone f8a364e8-7975-46d3-a21f-4f338e1f8423 from image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}]). {{(pid=86366) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 21 11:57:35 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1d6f6dac-43f2-4fcf-98be-a0ebf984e6fe tempest-VolumesActionsTest-33188292 None] Acquiring lock "cinder-a55e8d08-4354-4179-9609-260e26681632" by "attach_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:57:36 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1d6f6dac-43f2-4fcf-98be-a0ebf984e6fe tempest-VolumesActionsTest-33188292 None] Lock "cinder-a55e8d08-4354-4179-9609-260e26681632" acquired by "attach_volume" :: waited 0.048s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:57:36 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1d6f6dac-43f2-4fcf-98be-a0ebf984e6fe tempest-VolumesActionsTest-33188292 None] Attaching volume a55e8d08-4354-4179-9609-260e26681632 to instance a2d402d5-a54f-443d-9a84-e2b26a6dea6b at mountpoint /dev/vdb on host None. Sep 21 11:57:36 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1d6f6dac-43f2-4fcf-98be-a0ebf984e6fe tempest-VolumesActionsTest-33188292 None] Attach volume completed successfully. Sep 21 11:57:36 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_hvxdeh7adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 21 11:57:36 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Image download 20.69 MB at 20.69 MB/s Sep 21 11:57:36 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1d6f6dac-43f2-4fcf-98be-a0ebf984e6fe tempest-VolumesActionsTest-33188292 None] Lock "cinder-a55e8d08-4354-4179-9609-260e26681632" released by "attach_volume" :: held 0.318s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:57:36 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9c3a72-37cb-4c3e-b541-7ee1d299b4e8]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:57:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_hvxdeh7adevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:36 devstack sudo[95396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_hvxdeh7adevstack@QuobyteHD Sep 21 11:57:36 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:36 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2a561465-2f54-4b6d-9929-86f75a979a36 tempest-VolumesActionsTest-33188292 None] Acquiring lock "cinder-a55e8d08-4354-4179-9609-260e26681632-detach_volume" by "detach_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:57:36 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2a561465-2f54-4b6d-9929-86f75a979a36 tempest-VolumesActionsTest-33188292 None] Lock "cinder-a55e8d08-4354-4179-9609-260e26681632-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:57:36 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-2a561465-2f54-4b6d-9929-86f75a979a36 tempest-VolumesActionsTest-33188292 None] Detaching volume a55e8d08-4354-4179-9609-260e26681632 from instance a2d402d5-a54f-443d-9a84-e2b26a6dea6b. Sep 21 11:57:36 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-2a561465-2f54-4b6d-9929-86f75a979a36 tempest-VolumesActionsTest-33188292 None] Detach volume completed successfully. Sep 21 11:57:36 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2a561465-2f54-4b6d-9929-86f75a979a36 tempest-VolumesActionsTest-33188292 None] Lock "cinder-a55e8d08-4354-4179-9609-260e26681632-detach_volume" released by "detach_volume" :: held 0.103s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:57:36 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_hvxdeh7adevstack@QuobyteHD" returned: 0 in 0.553s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:36 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Temporary image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 is fetched for user 0d48ac6de85c4d1cb372db3c2f37c87f. {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 21 11:57:37 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6e9d8b-1769-4489-8e62-911b707105f6]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:57:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_hvxdeh7adevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:37 devstack sudo[95402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_hvxdeh7adevstack@QuobyteHD Sep 21 11:57:37 devstack sudo[95402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:37 devstack sudo[95402]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_hvxdeh7adevstack@QuobyteHD" returned: 0 in 0.547s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:57:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:57:37 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-998616117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8a364e8-7975-46d3-a21f-4f338e1f8423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb6589e2d2d94db1b852a669541e805e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:57:35Z,use_quota=True,user_id='0d48ac6de85c4d1cb372db3c2f37c87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:57:37 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Creating volume f8a364e8-7975-46d3-a21f-4f338e1f8423 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:57:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:57:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:57:37 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:57:37 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:57:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:57:37 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:57:37 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:57:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f8a364e8-7975-46d3-a21f-4f338e1f8423 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:37 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:57:37 devstack sudo[95412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f8a364e8-7975-46d3-a21f-4f338e1f8423 1073741824 Sep 21 11:57:37 devstack sudo[95412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:37 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Flow 'volume_create_manager' (d686f89f-21a0-423d-9ca0-f165a386f6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:57:37 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7998fe5a-17e8-4610-b291-82d48d2512e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:37 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7998fe5a-17e8-4610-b291-82d48d2512e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2105771777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c591b6fc9b943c3baf91be484a47042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:57:38Z,use_quota=True,user_id='13275be66bd7420ca97d33800442d39c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:37 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ffe41fd-3be5-4158-ab1f-5e2573e32034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:37 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ffe41fd-3be5-4158-ab1f-5e2573e32034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:37 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21796b3-fff8-41d1-bda1-6358681f67f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:37 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21796b3-fff8-41d1-bda1-6358681f67f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8', 'volume_name': 'volume-10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:37 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71cc0e28-ca9d-4141-8147-0142c5ba7bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:37 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71cc0e28-ca9d-4141-8147-0142c5ba7bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:37 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (556155a1-74db-4ded-912b-1b021eed9da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:37 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Volume 10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8', 'volume_size': 1} Sep 21 11:57:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:57:38 devstack sudo[95412]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f8a364e8-7975-46d3-a21f-4f338e1f8423 1073741824" returned: 0 in 0.744s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f8a364e8-7975-46d3-a21f-4f338e1f8423 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:38 devstack sudo[95434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f8a364e8-7975-46d3-a21f-4f338e1f8423 Sep 21 11:57:38 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:38 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f8a364e8-7975-46d3-a21f-4f338e1f8423" returned: 0 in 0.263s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:57:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:57:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.825s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:57:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2105771777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c591b6fc9b943c3baf91be484a47042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:57:38Z,use_quota=True,user_id='13275be66bd7420ca97d33800442d39c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:57:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Creating volume 10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:57:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:57:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:57:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:57:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:57:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:57:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:57:38 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:57:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:38 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8 1073741824 Sep 21 11:57:38 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:38 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Attempting download of 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 ((None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}])) to volume f8a364e8-7975-46d3-a21f-4f338e1f8423. {{(pid=86366) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 21 11:57:38 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25f56b0-da45-4d90-a7e7-e2f791d4cb03]: (4, 'raw') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:57:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_7rzmj3ae {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:38 devstack sudo[95440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_7rzmj3ae Sep 21 11:57:38 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:39 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:39 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_7rzmj3ae" returned: 0 in 0.498s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_7rzmj3ae {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8 1073741824" returned: 0 in 0.604s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:39 devstack sudo[95449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8 Sep 21 11:57:39 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:39 devstack sudo[95448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_7rzmj3ae Sep 21 11:57:39 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:39 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8" returned: 0 in 0.320s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:39 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:57:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:57:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (556155a1-74db-4ded-912b-1b021eed9da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc76f599-d098-425d-b4ac-babb92ce762a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:39 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Volume volume-10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8 (10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8): created successfully Sep 21 11:57:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc76f599-d098-425d-b4ac-babb92ce762a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Flow 'volume_create_manager' (d686f89f-21a0-423d-9ca0-f165a386f6cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:57:39 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-9ddf2d0f-33bf-4d89-8720-dc0f1364922a tempest-AttachVolumeTestJSON-1328565065 None] Created volume successfully. Sep 21 11:57:39 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_7rzmj3ae" returned: 1 in 0.576s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_7rzmj3ae' failed. Not Retrying. {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 11:57:39 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[849fa156-2fe1-4b39-8c73-ddc7b867148b]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:57:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_hvxdeh7adevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:40 devstack sudo[95457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_hvxdeh7adevstack@QuobyteHD Sep 21 11:57:40 devstack sudo[95457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:40 devstack sudo[95457]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_hvxdeh7adevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:40 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 was qcow2, converting to qcow2 {{(pid=86366) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 21 11:57:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_hvxdeh7adevstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f8a364e8-7975-46d3-a21f-4f338e1f8423 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:40 devstack sudo[95462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_hvxdeh7adevstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f8a364e8-7975-46d3-a21f-4f338e1f8423 Sep 21 11:57:40 devstack sudo[95462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-acd1928a-40b2-46d5-b037-c0a28d255706 req-cc17e7ca-06b2-49e0-9f5b-0f6689e65f33 tempest-AttachVolumeTestJSON-1328565065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:57:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-acd1928a-40b2-46d5-b037-c0a28d255706 req-cc17e7ca-06b2-49e0-9f5b-0f6689e65f33 tempest-AttachVolumeTestJSON-1328565065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:57:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-acd1928a-40b2-46d5-b037-c0a28d255706 req-cc17e7ca-06b2-49e0-9f5b-0f6689e65f33 tempest-AttachVolumeTestJSON-1328565065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:57:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-acd1928a-40b2-46d5-b037-c0a28d255706 req-cc17e7ca-06b2-49e0-9f5b-0f6689e65f33 tempest-AttachVolumeTestJSON-1328565065 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d', 'name': 'volume-10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd6857350-7240-411d-bf1c-8e83c8272ab9', 'enforce_multipath': True} {{(pid=86366) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 11:57:42 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-acd1928a-40b2-46d5-b037-c0a28d255706 req-cc17e7ca-06b2-49e0-9f5b-0f6689e65f33 tempest-AttachVolumeTestJSON-1328565065 None] attachment_update completed successfully. Sep 21 11:57:43 devstack sudo[95462]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_hvxdeh7adevstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f8a364e8-7975-46d3-a21f-4f338e1f8423" returned: 0 in 2.718s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:43 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_hvxdeh7adevstack@QuobyteHD, size 112.00 MB, duration 2.72 sec, destination /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f8a364e8-7975-46d3-a21f-4f338e1f8423 {{(pid=86366) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 11:57:43 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Converted 112.00 MB image at 41.19 MB/s Sep 21 11:57:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f8a364e8-7975-46d3-a21f-4f338e1f8423 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:43 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f8a364e8-7975-46d3-a21f-4f338e1f8423 1G Sep 21 11:57:43 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:43 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f8a364e8-7975-46d3-a21f-4f338e1f8423 1G" returned: 0 in 0.551s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:43 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Downloaded image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 ((None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}])) to volume f8a364e8-7975-46d3-a21f-4f338e1f8423 successfully. {{(pid=86366) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 21 11:57:43 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Temporary image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 for user 0d48ac6de85c4d1cb372db3c2f37c87f is deleted. {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 21 11:57:43 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Marking volume f8a364e8-7975-46d3-a21f-4f338e1f8423 as bootable. {{(pid=86366) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 21 11:57:43 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Copying metadata from image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 to f8a364e8-7975-46d3-a21f-4f338e1f8423. {{(pid=86366) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 21 11:57:43 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Creating volume glance metadata for volume f8a364e8-7975-46d3-a21f-4f338e1f8423 backed by image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86366) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 21 11:57:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdc0d3c9-3280-4a00-8667-6247c33d8cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8a364e8-7975-46d3-a21f-4f338e1f8423', 'volume_size': 1, 'image_id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6c23462c1d34d9a9d8fbc8d8872d421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'created_at': datetime.datetime(2026, 9, 21, 9, 44, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 9, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d50ae68b-179a-4a0d-8730-61bacfd4b874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:43 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Volume volume-f8a364e8-7975-46d3-a21f-4f338e1f8423 (f8a364e8-7975-46d3-a21f-4f338e1f8423): created successfully Sep 21 11:57:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d50ae68b-179a-4a0d-8730-61bacfd4b874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Flow 'volume_create_manager' (5005aebb-820d-4253-b516-aab4b76188a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:57:43 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-20768f94-8aed-42df-bad8-111cc446c009 tempest-VolumesImageMetadata-1010678859 None] Created volume successfully. Sep 21 11:57:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b647dc0d-f2ab-479f-89df-7e6e22ebc1af tempest-VolumesImageMetadata-1010678859 None] Acquiring lock "cinder-f8a364e8-7975-46d3-a21f-4f338e1f8423-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:57:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b647dc0d-f2ab-479f-89df-7e6e22ebc1af tempest-VolumesImageMetadata-1010678859 None] Lock "cinder-f8a364e8-7975-46d3-a21f-4f338e1f8423-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:57:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b647dc0d-f2ab-479f-89df-7e6e22ebc1af tempest-VolumesImageMetadata-1010678859 None] Acquiring lock "cinder-quobyte-f8a364e8-7975-46d3-a21f-4f338e1f8423" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:57:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b647dc0d-f2ab-479f-89df-7e6e22ebc1af tempest-VolumesImageMetadata-1010678859 None] Lock "cinder-quobyte-f8a364e8-7975-46d3-a21f-4f338e1f8423" acquired by "delete_volume" :: waited 0.038s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:57:45 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77c07d4-7890-4d87-8bb5-916bf999979f]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:57:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b647dc0d-f2ab-479f-89df-7e6e22ebc1af tempest-VolumesImageMetadata-1010678859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f8a364e8-7975-46d3-a21f-4f338e1f8423 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:45 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f8a364e8-7975-46d3-a21f-4f338e1f8423 Sep 21 11:57:45 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:45 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-e33ed792-38ee-4648-baaf-6ce4acbced5e req-16fc4cde-cce3-482e-b9a0-5532d2cb211a tempest-AttachVolumeTestJSON-1328565065 None] Terminate volume connection completed successfully. Sep 21 11:57:45 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-e33ed792-38ee-4648-baaf-6ce4acbced5e req-16fc4cde-cce3-482e-b9a0-5532d2cb211a tempest-AttachVolumeTestJSON-1328565065 None] Deleting attachment f5d2515d-a887-4193-b23e-f58e205342e0. {{(pid=86366) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 11:57:46 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b647dc0d-f2ab-479f-89df-7e6e22ebc1af tempest-VolumesImageMetadata-1010678859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f8a364e8-7975-46d3-a21f-4f338e1f8423" returned: 0 in 0.533s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b647dc0d-f2ab-479f-89df-7e6e22ebc1af tempest-VolumesImageMetadata-1010678859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f8a364e8-7975-46d3-a21f-4f338e1f8423 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:46 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f8a364e8-7975-46d3-a21f-4f338e1f8423 Sep 21 11:57:46 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:46 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b647dc0d-f2ab-479f-89df-7e6e22ebc1af tempest-VolumesImageMetadata-1010678859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f8a364e8-7975-46d3-a21f-4f338e1f8423" returned: 0 in 0.296s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:46 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b647dc0d-f2ab-479f-89df-7e6e22ebc1af tempest-VolumesImageMetadata-1010678859 None] Lock "cinder-quobyte-f8a364e8-7975-46d3-a21f-4f338e1f8423" released by "delete_volume" :: held 0.897s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:57:46 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-b647dc0d-f2ab-479f-89df-7e6e22ebc1af tempest-VolumesImageMetadata-1010678859 None] Created reservations ['403495a1-39a4-4b51-9a47-bb5af07139b2', 'd3c565b5-0153-4643-8dae-cf28a6d5c5ab', 'bc8cfdc9-6cda-43d7-acf8-0d4242ad7c2a', '2888f1b5-f763-4b89-9ef5-1327745361fa'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:57:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b647dc0d-f2ab-479f-89df-7e6e22ebc1af tempest-VolumesImageMetadata-1010678859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:57:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b647dc0d-f2ab-479f-89df-7e6e22ebc1af tempest-VolumesImageMetadata-1010678859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:57:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b647dc0d-f2ab-479f-89df-7e6e22ebc1af tempest-VolumesImageMetadata-1010678859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:57:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b647dc0d-f2ab-479f-89df-7e6e22ebc1af tempest-VolumesImageMetadata-1010678859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:57:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b647dc0d-f2ab-479f-89df-7e6e22ebc1af tempest-VolumesImageMetadata-1010678859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:57:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b647dc0d-f2ab-479f-89df-7e6e22ebc1af tempest-VolumesImageMetadata-1010678859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:46 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:57:46 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:46 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b647dc0d-f2ab-479f-89df-7e6e22ebc1af tempest-VolumesImageMetadata-1010678859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.323s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:46 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-b647dc0d-f2ab-479f-89df-7e6e22ebc1af tempest-VolumesImageMetadata-1010678859 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:57:46 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-b647dc0d-f2ab-479f-89df-7e6e22ebc1af tempest-VolumesImageMetadata-1010678859 None] Deleted volume successfully. Sep 21 11:57:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b647dc0d-f2ab-479f-89df-7e6e22ebc1af tempest-VolumesImageMetadata-1010678859 None] Lock "cinder-f8a364e8-7975-46d3-a21f-4f338e1f8423-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:57:47 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-4a197deb-1cca-4a40-b62d-bec4de438535 req-38e21f28-5a84-43ab-9769-568900da2a05 tempest-AttachVolumeTestJSON-1328565065 None] Terminate volume connection completed successfully. Sep 21 11:57:47 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-4a197deb-1cca-4a40-b62d-bec4de438535 req-38e21f28-5a84-43ab-9769-568900da2a05 tempest-AttachVolumeTestJSON-1328565065 None] Deleting attachment d6857350-7240-411d-bf1c-8e83c8272ab9. {{(pid=86366) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 11:57:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-adac4f2c-4a7e-4004-a8f8-e671ca7ecc9c tempest-AttachVolumeTestJSON-1328565065 None] Acquiring lock "cinder-10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:57:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-adac4f2c-4a7e-4004-a8f8-e671ca7ecc9c tempest-AttachVolumeTestJSON-1328565065 None] Lock "cinder-10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:57:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-adac4f2c-4a7e-4004-a8f8-e671ca7ecc9c tempest-AttachVolumeTestJSON-1328565065 None] Acquiring lock "cinder-quobyte-10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:57:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-adac4f2c-4a7e-4004-a8f8-e671ca7ecc9c tempest-AttachVolumeTestJSON-1328565065 None] Lock "cinder-quobyte-10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8" acquired by "delete_volume" :: waited 0.044s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:57:54 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7c05dc-8af9-476d-a58d-894a095dc3dd]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:57:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-adac4f2c-4a7e-4004-a8f8-e671ca7ecc9c tempest-AttachVolumeTestJSON-1328565065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:54 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8 Sep 21 11:57:54 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:55 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-adac4f2c-4a7e-4004-a8f8-e671ca7ecc9c tempest-AttachVolumeTestJSON-1328565065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8" returned: 0 in 0.578s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-adac4f2c-4a7e-4004-a8f8-e671ca7ecc9c tempest-AttachVolumeTestJSON-1328565065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:55 devstack sudo[95686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8 Sep 21 11:57:55 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:55 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-adac4f2c-4a7e-4004-a8f8-e671ca7ecc9c tempest-AttachVolumeTestJSON-1328565065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8" returned: 0 in 0.497s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-adac4f2c-4a7e-4004-a8f8-e671ca7ecc9c tempest-AttachVolumeTestJSON-1328565065 None] Lock "cinder-quobyte-10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8" released by "delete_volume" :: held 1.167s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:57:55 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-adac4f2c-4a7e-4004-a8f8-e671ca7ecc9c tempest-AttachVolumeTestJSON-1328565065 None] Created reservations ['7e10693d-0565-478a-89e7-fa6e59f55165', '41504e71-1d36-4aff-8b9d-2747e4e942ef', '061b8934-2ad4-403a-b627-4b841f81270f', '28d4a7ed-ae21-43db-bb9c-89e9d512afc3'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:57:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-adac4f2c-4a7e-4004-a8f8-e671ca7ecc9c tempest-AttachVolumeTestJSON-1328565065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:57:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-adac4f2c-4a7e-4004-a8f8-e671ca7ecc9c tempest-AttachVolumeTestJSON-1328565065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:57:55 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-adac4f2c-4a7e-4004-a8f8-e671ca7ecc9c tempest-AttachVolumeTestJSON-1328565065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:57:55 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-adac4f2c-4a7e-4004-a8f8-e671ca7ecc9c tempest-AttachVolumeTestJSON-1328565065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:57:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-adac4f2c-4a7e-4004-a8f8-e671ca7ecc9c tempest-AttachVolumeTestJSON-1328565065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:57:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-adac4f2c-4a7e-4004-a8f8-e671ca7ecc9c tempest-AttachVolumeTestJSON-1328565065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:55 devstack sudo[95689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:57:55 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Flow 'volume_create_manager' (c4d45d1b-f75e-4af8-85f6-35c37164fdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7cc4c6-be3a-4282-83d3-d98ab885487b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7cc4c6-be3a-4282-83d3-d98ab885487b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1540544918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7415d8bf-59bd-4378-9571-3484d311abce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d65c0150580840638325d3b9580dfa4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:57:56Z,use_quota=True,user_id='f82530f1e19c486e97a3b2309260ba6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef18b6b-fea6-4eaa-9bd6-d3ba938ced13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef18b6b-fea6-4eaa-9bd6-d3ba938ced13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc982c2b-c4c1-46e2-ba83-0e831371a000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc982c2b-c4c1-46e2-ba83-0e831371a000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7415d8bf-59bd-4378-9571-3484d311abce', 'volume_name': 'volume-7415d8bf-59bd-4378-9571-3484d311abce', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (783d4f90-18c5-44b9-98dd-aef7b81c5706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (783d4f90-18c5-44b9-98dd-aef7b81c5706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e986e4e9-b403-4ea3-959a-5f2371efa4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:56 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Volume 7415d8bf-59bd-4378-9571-3484d311abce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7415d8bf-59bd-4378-9571-3484d311abce', 'volume_size': 1} Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1540544918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7415d8bf-59bd-4378-9571-3484d311abce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d65c0150580840638325d3b9580dfa4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:57:56Z,use_quota=True,user_id='f82530f1e19c486e97a3b2309260ba6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Creating volume 7415d8bf-59bd-4378-9571-3484d311abce {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:57:56 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7415d8bf-59bd-4378-9571-3484d311abce 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:56 devstack sudo[95691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7415d8bf-59bd-4378-9571-3484d311abce 1073741824 Sep 21 11:57:56 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:56 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-adac4f2c-4a7e-4004-a8f8-e671ca7ecc9c tempest-AttachVolumeTestJSON-1328565065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.593s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-adac4f2c-4a7e-4004-a8f8-e671ca7ecc9c tempest-AttachVolumeTestJSON-1328565065 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:57:56 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-adac4f2c-4a7e-4004-a8f8-e671ca7ecc9c tempest-AttachVolumeTestJSON-1328565065 None] Deleted volume successfully. Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-adac4f2c-4a7e-4004-a8f8-e671ca7ecc9c tempest-AttachVolumeTestJSON-1328565065 None] Lock "cinder-10b7ecfe-e2ea-4a3d-9bb5-68b4196681a8-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-802202cc-14bb-4b47-9a1e-05a2a29ae6b2 tempest-AttachVolumeTestJSON-1328565065 None] Acquiring lock "cinder-d9973cbb-59ee-431e-86f6-21a6c222b3fe-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-802202cc-14bb-4b47-9a1e-05a2a29ae6b2 tempest-AttachVolumeTestJSON-1328565065 None] Lock "cinder-d9973cbb-59ee-431e-86f6-21a6c222b3fe-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-802202cc-14bb-4b47-9a1e-05a2a29ae6b2 tempest-AttachVolumeTestJSON-1328565065 None] Acquiring lock "cinder-quobyte-d9973cbb-59ee-431e-86f6-21a6c222b3fe" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-802202cc-14bb-4b47-9a1e-05a2a29ae6b2 tempest-AttachVolumeTestJSON-1328565065 None] Lock "cinder-quobyte-d9973cbb-59ee-431e-86f6-21a6c222b3fe" acquired by "delete_volume" :: waited 0.039s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6797d26-df7d-4300-9876-a744a98f9d31]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:57:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-802202cc-14bb-4b47-9a1e-05a2a29ae6b2 tempest-AttachVolumeTestJSON-1328565065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d9973cbb-59ee-431e-86f6-21a6c222b3fe {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:57 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d9973cbb-59ee-431e-86f6-21a6c222b3fe Sep 21 11:57:57 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:57 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7415d8bf-59bd-4378-9571-3484d311abce 1073741824" returned: 0 in 0.927s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7415d8bf-59bd-4378-9571-3484d311abce {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:57 devstack sudo[95700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7415d8bf-59bd-4378-9571-3484d311abce Sep 21 11:57:57 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:57 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7415d8bf-59bd-4378-9571-3484d311abce" returned: 0 in 0.389s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:57:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:57:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e986e4e9-b403-4ea3-959a-5f2371efa4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7415d8bf-59bd-4378-9571-3484d311abce', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780f4efd-b4c7-4233-ab9b-a4523d152276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:57:57 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-802202cc-14bb-4b47-9a1e-05a2a29ae6b2 tempest-AttachVolumeTestJSON-1328565065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d9973cbb-59ee-431e-86f6-21a6c222b3fe" returned: 0 in 0.735s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-802202cc-14bb-4b47-9a1e-05a2a29ae6b2 tempest-AttachVolumeTestJSON-1328565065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d9973cbb-59ee-431e-86f6-21a6c222b3fe {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:57 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Volume volume-7415d8bf-59bd-4378-9571-3484d311abce (7415d8bf-59bd-4378-9571-3484d311abce): created successfully Sep 21 11:57:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780f4efd-b4c7-4233-ab9b-a4523d152276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:57:57 devstack sudo[95707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d9973cbb-59ee-431e-86f6-21a6c222b3fe Sep 21 11:57:57 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Flow 'volume_create_manager' (c4d45d1b-f75e-4af8-85f6-35c37164fdc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:57:57 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-92afc5e7-2ca7-407d-a2e8-58a65922f5c3 tempest-VolumesTransfersTest-871033039 None] Created volume successfully. Sep 21 11:57:57 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5c91c6d4-5efc-414b-a97a-65e61bcca981 tempest-VolumesActionsTest-33188292 None] Acquiring lock "cinder-a55e8d08-4354-4179-9609-260e26681632" by "attach_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:57:57 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5c91c6d4-5efc-414b-a97a-65e61bcca981 tempest-VolumesActionsTest-33188292 None] Lock "cinder-a55e8d08-4354-4179-9609-260e26681632" acquired by "attach_volume" :: waited 0.045s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:57:58 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-5c91c6d4-5efc-414b-a97a-65e61bcca981 tempest-VolumesActionsTest-33188292 None] Attaching volume a55e8d08-4354-4179-9609-260e26681632 to instance c13f590e-53cf-48c9-8a88-520d2b3eb9d9 at mountpoint /dev/vdb on host None. Sep 21 11:57:58 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-5c91c6d4-5efc-414b-a97a-65e61bcca981 tempest-VolumesActionsTest-33188292 None] Attach volume completed successfully. Sep 21 11:57:58 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5c91c6d4-5efc-414b-a97a-65e61bcca981 tempest-VolumesActionsTest-33188292 None] Lock "cinder-a55e8d08-4354-4179-9609-260e26681632" released by "attach_volume" :: held 0.231s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:57:58 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-802202cc-14bb-4b47-9a1e-05a2a29ae6b2 tempest-AttachVolumeTestJSON-1328565065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d9973cbb-59ee-431e-86f6-21a6c222b3fe" returned: 0 in 0.571s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:58 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-802202cc-14bb-4b47-9a1e-05a2a29ae6b2 tempest-AttachVolumeTestJSON-1328565065 None] Lock "cinder-quobyte-d9973cbb-59ee-431e-86f6-21a6c222b3fe" released by "delete_volume" :: held 1.386s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:57:58 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-802202cc-14bb-4b47-9a1e-05a2a29ae6b2 tempest-AttachVolumeTestJSON-1328565065 None] Created reservations ['f3c8df18-2625-4d57-87ef-30a329e32f75', '1f2e87c1-0bae-4fdb-8f21-770aa9e0152e', '3f22fc21-ada1-43f9-8225-71a56688ed96', 'f73c8912-eff6-48d5-8fd9-ee8061054e2f'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:57:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-802202cc-14bb-4b47-9a1e-05a2a29ae6b2 tempest-AttachVolumeTestJSON-1328565065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:57:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-802202cc-14bb-4b47-9a1e-05a2a29ae6b2 tempest-AttachVolumeTestJSON-1328565065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:57:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-802202cc-14bb-4b47-9a1e-05a2a29ae6b2 tempest-AttachVolumeTestJSON-1328565065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:57:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-802202cc-14bb-4b47-9a1e-05a2a29ae6b2 tempest-AttachVolumeTestJSON-1328565065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:57:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-802202cc-14bb-4b47-9a1e-05a2a29ae6b2 tempest-AttachVolumeTestJSON-1328565065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:57:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-802202cc-14bb-4b47-9a1e-05a2a29ae6b2 tempest-AttachVolumeTestJSON-1328565065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:57:58 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:57:58 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:57:58 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e86a7d68-5f4c-44f9-9f25-670d116abb29 tempest-VolumesActionsTest-33188292 None] Acquiring lock "cinder-a55e8d08-4354-4179-9609-260e26681632-detach_volume" by "detach_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:57:58 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e86a7d68-5f4c-44f9-9f25-670d116abb29 tempest-VolumesActionsTest-33188292 None] Lock "cinder-a55e8d08-4354-4179-9609-260e26681632-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:57:58 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-e86a7d68-5f4c-44f9-9f25-670d116abb29 tempest-VolumesActionsTest-33188292 None] Detaching volume a55e8d08-4354-4179-9609-260e26681632 from instance c13f590e-53cf-48c9-8a88-520d2b3eb9d9. Sep 21 11:57:58 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-e86a7d68-5f4c-44f9-9f25-670d116abb29 tempest-VolumesActionsTest-33188292 None] Detach volume completed successfully. Sep 21 11:57:58 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e86a7d68-5f4c-44f9-9f25-670d116abb29 tempest-VolumesActionsTest-33188292 None] Lock "cinder-a55e8d08-4354-4179-9609-260e26681632-detach_volume" released by "detach_volume" :: held 0.139s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:57:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-794e6fde-89c8-4f9a-83dc-337a4992e980 tempest-AttachVolumeTestJSON-1328565065 None] Acquiring lock "cinder-d645323d-50d5-48ec-9a92-bceb0c6f1c06-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:57:59 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Sep 21 11:57:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-802202cc-14bb-4b47-9a1e-05a2a29ae6b2 tempest-AttachVolumeTestJSON-1328565065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.970s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:57:59 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-802202cc-14bb-4b47-9a1e-05a2a29ae6b2 tempest-AttachVolumeTestJSON-1328565065 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:57:59 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-802202cc-14bb-4b47-9a1e-05a2a29ae6b2 tempest-AttachVolumeTestJSON-1328565065 None] Deleted volume successfully. Sep 21 11:57:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-794e6fde-89c8-4f9a-83dc-337a4992e980 tempest-AttachVolumeTestJSON-1328565065 None] Lock "cinder-d645323d-50d5-48ec-9a92-bceb0c6f1c06-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:57:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-802202cc-14bb-4b47-9a1e-05a2a29ae6b2 tempest-AttachVolumeTestJSON-1328565065 None] Lock "cinder-d9973cbb-59ee-431e-86f6-21a6c222b3fe-delete_volume" released by "delete_volume" :: held 2.889s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:57:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-794e6fde-89c8-4f9a-83dc-337a4992e980 tempest-AttachVolumeTestJSON-1328565065 None] Acquiring lock "cinder-quobyte-d645323d-50d5-48ec-9a92-bceb0c6f1c06" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:57:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-794e6fde-89c8-4f9a-83dc-337a4992e980 tempest-AttachVolumeTestJSON-1328565065 None] Lock "cinder-quobyte-d645323d-50d5-48ec-9a92-bceb0c6f1c06" acquired by "delete_volume" :: waited 0.018s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:57:59 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c881a09-b70c-44a1-979f-0bdc5d69cee1]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:57:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-794e6fde-89c8-4f9a-83dc-337a4992e980 tempest-AttachVolumeTestJSON-1328565065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d645323d-50d5-48ec-9a92-bceb0c6f1c06 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:00 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-360bf698-76c2-4d33-ab45-025376415afe tempest-VolumesTransfersTest-1795025976 None] Transfer volume completed successfully. Sep 21 11:58:00 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d645323d-50d5-48ec-9a92-bceb0c6f1c06 Sep 21 11:58:00 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:00 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-794e6fde-89c8-4f9a-83dc-337a4992e980 tempest-AttachVolumeTestJSON-1328565065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d645323d-50d5-48ec-9a92-bceb0c6f1c06" returned: 0 in 0.854s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-794e6fde-89c8-4f9a-83dc-337a4992e980 tempest-AttachVolumeTestJSON-1328565065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d645323d-50d5-48ec-9a92-bceb0c6f1c06 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:00 devstack sudo[95746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d645323d-50d5-48ec-9a92-bceb0c6f1c06 Sep 21 11:58:00 devstack sudo[95746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:01 devstack sudo[95746]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-794e6fde-89c8-4f9a-83dc-337a4992e980 tempest-AttachVolumeTestJSON-1328565065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d645323d-50d5-48ec-9a92-bceb0c6f1c06" returned: 0 in 0.387s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:01 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-794e6fde-89c8-4f9a-83dc-337a4992e980 tempest-AttachVolumeTestJSON-1328565065 None] Lock "cinder-quobyte-d645323d-50d5-48ec-9a92-bceb0c6f1c06" released by "delete_volume" :: held 1.309s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:58:01 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-794e6fde-89c8-4f9a-83dc-337a4992e980 tempest-AttachVolumeTestJSON-1328565065 None] Created reservations ['13588573-0cd2-43ca-b208-6c65842129b8', 'b351f621-d4ed-4d82-a80c-03bce717cab4', '0fbd623a-432c-4058-89bf-1d854bc1c198', 'f17b758c-e539-4217-a7d7-3f43f340e644'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:58:01 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7c0e3da4-23b8-4dec-9a98-49c99bc50abd tempest-VolumesTransfersTest-405822869 None] Acquiring lock "cinder-7415d8bf-59bd-4378-9571-3484d311abce-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:58:01 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7c0e3da4-23b8-4dec-9a98-49c99bc50abd tempest-VolumesTransfersTest-405822869 None] Lock "cinder-7415d8bf-59bd-4378-9571-3484d311abce-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:58:01 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7c0e3da4-23b8-4dec-9a98-49c99bc50abd tempest-VolumesTransfersTest-405822869 None] Acquiring lock "cinder-quobyte-7415d8bf-59bd-4378-9571-3484d311abce" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:58:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-794e6fde-89c8-4f9a-83dc-337a4992e980 tempest-AttachVolumeTestJSON-1328565065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:58:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-794e6fde-89c8-4f9a-83dc-337a4992e980 tempest-AttachVolumeTestJSON-1328565065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:58:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-794e6fde-89c8-4f9a-83dc-337a4992e980 tempest-AttachVolumeTestJSON-1328565065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:58:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-794e6fde-89c8-4f9a-83dc-337a4992e980 tempest-AttachVolumeTestJSON-1328565065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:58:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-794e6fde-89c8-4f9a-83dc-337a4992e980 tempest-AttachVolumeTestJSON-1328565065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:58:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-794e6fde-89c8-4f9a-83dc-337a4992e980 tempest-AttachVolumeTestJSON-1328565065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:01 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7c0e3da4-23b8-4dec-9a98-49c99bc50abd tempest-VolumesTransfersTest-405822869 None] Lock "cinder-quobyte-7415d8bf-59bd-4378-9571-3484d311abce" acquired by "delete_volume" :: waited 0.070s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:58:01 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:58:01 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:01 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d077fe-7c1e-40fb-9cee-4261b7ce0378]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:58:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7c0e3da4-23b8-4dec-9a98-49c99bc50abd tempest-VolumesTransfersTest-405822869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7415d8bf-59bd-4378-9571-3484d311abce {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:01 devstack sudo[95751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7415d8bf-59bd-4378-9571-3484d311abce Sep 21 11:58:01 devstack sudo[95751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:01 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-794e6fde-89c8-4f9a-83dc-337a4992e980 tempest-AttachVolumeTestJSON-1328565065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.378s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:01 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-794e6fde-89c8-4f9a-83dc-337a4992e980 tempest-AttachVolumeTestJSON-1328565065 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:58:01 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-794e6fde-89c8-4f9a-83dc-337a4992e980 tempest-AttachVolumeTestJSON-1328565065 None] Deleted volume successfully. Sep 21 11:58:01 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-794e6fde-89c8-4f9a-83dc-337a4992e980 tempest-AttachVolumeTestJSON-1328565065 None] Lock "cinder-d645323d-50d5-48ec-9a92-bceb0c6f1c06-delete_volume" released by "delete_volume" :: held 2.155s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:58:02 devstack sudo[95751]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7c0e3da4-23b8-4dec-9a98-49c99bc50abd tempest-VolumesTransfersTest-405822869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7415d8bf-59bd-4378-9571-3484d311abce" returned: 0 in 0.636s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7c0e3da4-23b8-4dec-9a98-49c99bc50abd tempest-VolumesTransfersTest-405822869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7415d8bf-59bd-4378-9571-3484d311abce {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:02 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7415d8bf-59bd-4378-9571-3484d311abce Sep 21 11:58:02 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:02 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7c0e3da4-23b8-4dec-9a98-49c99bc50abd tempest-VolumesTransfersTest-405822869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7415d8bf-59bd-4378-9571-3484d311abce" returned: 0 in 0.434s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:02 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7c0e3da4-23b8-4dec-9a98-49c99bc50abd tempest-VolumesTransfersTest-405822869 None] Lock "cinder-quobyte-7415d8bf-59bd-4378-9571-3484d311abce" released by "delete_volume" :: held 1.149s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:58:02 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-7c0e3da4-23b8-4dec-9a98-49c99bc50abd tempest-VolumesTransfersTest-405822869 None] Created reservations ['188dfdc2-2bb5-4060-9e56-313efa867247', '7f9a882e-9f01-4dfd-ade6-76e17c3cf74d', '71229db7-feba-4d18-a5c1-4533a827b3f2', 'a1ab695f-8061-4daf-874c-d97c36371d1a'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:58:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7c0e3da4-23b8-4dec-9a98-49c99bc50abd tempest-VolumesTransfersTest-405822869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:58:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7c0e3da4-23b8-4dec-9a98-49c99bc50abd tempest-VolumesTransfersTest-405822869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:58:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-7c0e3da4-23b8-4dec-9a98-49c99bc50abd tempest-VolumesTransfersTest-405822869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:58:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-7c0e3da4-23b8-4dec-9a98-49c99bc50abd tempest-VolumesTransfersTest-405822869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:58:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7c0e3da4-23b8-4dec-9a98-49c99bc50abd tempest-VolumesTransfersTest-405822869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:58:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7c0e3da4-23b8-4dec-9a98-49c99bc50abd tempest-VolumesTransfersTest-405822869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:02 devstack sudo[95763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:58:02 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:03 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7c0e3da4-23b8-4dec-9a98-49c99bc50abd tempest-VolumesTransfersTest-405822869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.350s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:03 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-7c0e3da4-23b8-4dec-9a98-49c99bc50abd tempest-VolumesTransfersTest-405822869 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:58:03 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-7c0e3da4-23b8-4dec-9a98-49c99bc50abd tempest-VolumesTransfersTest-405822869 None] Deleted volume successfully. Sep 21 11:58:03 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7c0e3da4-23b8-4dec-9a98-49c99bc50abd tempest-VolumesTransfersTest-405822869 None] Lock "cinder-7415d8bf-59bd-4378-9571-3484d311abce-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:58:03 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 11:58:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:58:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:58:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:58:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:58:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:58:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:03 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:58:03 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:04 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.455s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:04 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:58:04 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 11:58:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread count: 28 {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 11:58:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread info: [<_MainThread(MainThread, started 132841976594560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 11:58:04 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:58:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Flow 'volume_create_manager' (f31b769e-8f43-457c-9bcb-d5d470776192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:58:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ac9624-286f-4b00-858a-0aecc73d0f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ac9624-286f-4b00-858a-0aecc73d0f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-544090302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4251c065-2885-4cfa-8c41-3f8d8c8c1f9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d65c0150580840638325d3b9580dfa4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:58:04Z,use_quota=True,user_id='f82530f1e19c486e97a3b2309260ba6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc99703b-305d-432b-a3b4-c9dd9cdd27c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc99703b-305d-432b-a3b4-c9dd9cdd27c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e289263f-e9a7-4d7f-a4da-53b1de220ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e289263f-e9a7-4d7f-a4da-53b1de220ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4251c065-2885-4cfa-8c41-3f8d8c8c1f9e', 'volume_name': 'volume-4251c065-2885-4cfa-8c41-3f8d8c8c1f9e', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1356a4d7-aee7-4d31-a8ae-9e43d95c8a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1356a4d7-aee7-4d31-a8ae-9e43d95c8a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba298653-cf04-4b4a-9206-26882ed8e1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:04 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Volume 4251c065-2885-4cfa-8c41-3f8d8c8c1f9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4251c065-2885-4cfa-8c41-3f8d8c8c1f9e', 'volume_size': 1} Sep 21 11:58:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:58:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:58:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-544090302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4251c065-2885-4cfa-8c41-3f8d8c8c1f9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d65c0150580840638325d3b9580dfa4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:58:04Z,use_quota=True,user_id='f82530f1e19c486e97a3b2309260ba6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:58:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Creating volume 4251c065-2885-4cfa-8c41-3f8d8c8c1f9e {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:58:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:58:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:58:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:58:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:58:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:58:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:58:04 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:58:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4251c065-2885-4cfa-8c41-3f8d8c8c1f9e 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:04 devstack sudo[95773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4251c065-2885-4cfa-8c41-3f8d8c8c1f9e 1073741824 Sep 21 11:58:04 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:05 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4251c065-2885-4cfa-8c41-3f8d8c8c1f9e 1073741824" returned: 0 in 0.784s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4251c065-2885-4cfa-8c41-3f8d8c8c1f9e {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:05 devstack sudo[95779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4251c065-2885-4cfa-8c41-3f8d8c8c1f9e Sep 21 11:58:05 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:05 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4251c065-2885-4cfa-8c41-3f8d8c8c1f9e" returned: 0 in 0.476s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:05 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:58:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:58:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba298653-cf04-4b4a-9206-26882ed8e1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4251c065-2885-4cfa-8c41-3f8d8c8c1f9e', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa555865-fdff-4fbb-8a94-3f5eb26c4a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:05 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Volume volume-4251c065-2885-4cfa-8c41-3f8d8c8c1f9e (4251c065-2885-4cfa-8c41-3f8d8c8c1f9e): created successfully Sep 21 11:58:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa555865-fdff-4fbb-8a94-3f5eb26c4a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Flow 'volume_create_manager' (f31b769e-8f43-457c-9bcb-d5d470776192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:58:05 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-8bfe408b-ef01-48ee-83e8-0af6ae79eb34 tempest-VolumesTransfersTest-871033039 None] Created volume successfully. Sep 21 11:58:06 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5e425cf0-31c7-4625-bab4-a8b53fb62dd1 tempest-VolumesTransfersTest-405822869 None] Acquiring lock "cinder-4251c065-2885-4cfa-8c41-3f8d8c8c1f9e-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:58:06 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5e425cf0-31c7-4625-bab4-a8b53fb62dd1 tempest-VolumesTransfersTest-405822869 None] Lock "cinder-4251c065-2885-4cfa-8c41-3f8d8c8c1f9e-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:58:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-25d7fe58-174f-455e-b404-8b091cc237f3 tempest-VolumesActionsTest-33188292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:58:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-25d7fe58-174f-455e-b404-8b091cc237f3 tempest-VolumesActionsTest-33188292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:58:07 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8335d8-0bed-482a-b18b-227ebf08cdb0]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:58:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-25d7fe58-174f-455e-b404-8b091cc237f3 tempest-VolumesActionsTest-33188292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:07 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5e425cf0-31c7-4625-bab4-a8b53fb62dd1 tempest-VolumesTransfersTest-405822869 None] Acquiring lock "cinder-quobyte-4251c065-2885-4cfa-8c41-3f8d8c8c1f9e" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:58:07 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5e425cf0-31c7-4625-bab4-a8b53fb62dd1 tempest-VolumesTransfersTest-405822869 None] Lock "cinder-quobyte-4251c065-2885-4cfa-8c41-3f8d8c8c1f9e" acquired by "delete_volume" :: waited 0.030s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:58:07 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b71180-78ac-447e-ae4f-ee1a0e73a197]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:58:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5e425cf0-31c7-4625-bab4-a8b53fb62dd1 tempest-VolumesTransfersTest-405822869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4251c065-2885-4cfa-8c41-3f8d8c8c1f9e {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:07 devstack sudo[95798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632 Sep 21 11:58:07 devstack sudo[95798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:07 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4251c065-2885-4cfa-8c41-3f8d8c8c1f9e Sep 21 11:58:07 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:07 devstack sudo[95798]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-25d7fe58-174f-455e-b404-8b091cc237f3 tempest-VolumesActionsTest-33188292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632" returned: 0 in 0.565s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:07 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d2c6eb-7370-43f8-b978-3d51d04be1a0]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:58:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-25d7fe58-174f-455e-b404-8b091cc237f3 tempest-VolumesActionsTest-33188292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:07 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5e425cf0-31c7-4625-bab4-a8b53fb62dd1 tempest-VolumesTransfersTest-405822869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4251c065-2885-4cfa-8c41-3f8d8c8c1f9e" returned: 0 in 0.558s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5e425cf0-31c7-4625-bab4-a8b53fb62dd1 tempest-VolumesTransfersTest-405822869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4251c065-2885-4cfa-8c41-3f8d8c8c1f9e {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:07 devstack sudo[95809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4251c065-2885-4cfa-8c41-3f8d8c8c1f9e Sep 21 11:58:07 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:07 devstack sudo[95807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632 Sep 21 11:58:07 devstack sudo[95807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:08 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5e425cf0-31c7-4625-bab4-a8b53fb62dd1 tempest-VolumesTransfersTest-405822869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4251c065-2885-4cfa-8c41-3f8d8c8c1f9e" returned: 0 in 0.328s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:08 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5e425cf0-31c7-4625-bab4-a8b53fb62dd1 tempest-VolumesTransfersTest-405822869 None] Lock "cinder-quobyte-4251c065-2885-4cfa-8c41-3f8d8c8c1f9e" released by "delete_volume" :: held 0.991s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:58:08 devstack sudo[95807]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-25d7fe58-174f-455e-b404-8b091cc237f3 tempest-VolumesActionsTest-33188292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632" returned: 0 in 0.483s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-25d7fe58-174f-455e-b404-8b091cc237f3 tempest-VolumesActionsTest-33188292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632 /opt/stack/data/cinder/conversion/a55e8d08-4354-4179-9609-260e26681632.temp_image.b150969e-e466-46a2-9579-3be09e86f209eiudx7e9.img {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:08 devstack sudo[95817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632 /opt/stack/data/cinder/conversion/a55e8d08-4354-4179-9609-260e26681632.temp_image.b150969e-e466-46a2-9579-3be09e86f209eiudx7e9.img Sep 21 11:58:08 devstack sudo[95817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:08 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-5e425cf0-31c7-4625-bab4-a8b53fb62dd1 tempest-VolumesTransfersTest-405822869 None] Created reservations ['81b3ed3a-f925-4698-b4c9-825c17c75d48', '48342294-2508-4489-b721-c04ecc0606a4', '2be69ea0-f035-42ee-9fe7-6f49097dadc9', 'd4844bfc-0520-4c5a-a2b4-515f4eb5ad32'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:58:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5e425cf0-31c7-4625-bab4-a8b53fb62dd1 tempest-VolumesTransfersTest-405822869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:58:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5e425cf0-31c7-4625-bab4-a8b53fb62dd1 tempest-VolumesTransfersTest-405822869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:58:08 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5e425cf0-31c7-4625-bab4-a8b53fb62dd1 tempest-VolumesTransfersTest-405822869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:58:08 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5e425cf0-31c7-4625-bab4-a8b53fb62dd1 tempest-VolumesTransfersTest-405822869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:58:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5e425cf0-31c7-4625-bab4-a8b53fb62dd1 tempest-VolumesTransfersTest-405822869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:58:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5e425cf0-31c7-4625-bab4-a8b53fb62dd1 tempest-VolumesTransfersTest-405822869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:08 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:58:08 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:08 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5e425cf0-31c7-4625-bab4-a8b53fb62dd1 tempest-VolumesTransfersTest-405822869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.484s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:08 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-5e425cf0-31c7-4625-bab4-a8b53fb62dd1 tempest-VolumesTransfersTest-405822869 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:58:08 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-5e425cf0-31c7-4625-bab4-a8b53fb62dd1 tempest-VolumesTransfersTest-405822869 None] Deleted volume successfully. Sep 21 11:58:08 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5e425cf0-31c7-4625-bab4-a8b53fb62dd1 tempest-VolumesTransfersTest-405822869 None] Lock "cinder-4251c065-2885-4cfa-8c41-3f8d8c8c1f9e-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:58:18 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:INSERT=34,cinder:UPDATE=114,cinder:SELECT=100,cinder:DELETE=11 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:58:18 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=104,cinder:INSERT=33,cinder:UPDATE=118,cinder:DELETE=6 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:58:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-25d7fe58-174f-455e-b404-8b091cc237f3 tempest-VolumesActionsTest-33188292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632 /opt/stack/data/cinder/conversion/a55e8d08-4354-4179-9609-260e26681632.temp_image.b150969e-e466-46a2-9579-3be09e86f209eiudx7e9.img" returned: 0 in 11.343s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:19 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d93c79-3f5b-4c44-9aef-26ae70954628]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:58:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-25d7fe58-174f-455e-b404-8b091cc237f3 tempest-VolumesActionsTest-33188292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:19 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632 Sep 21 11:58:19 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:20 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-25d7fe58-174f-455e-b404-8b091cc237f3 tempest-VolumesActionsTest-33188292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632" returned: 0 in 0.940s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:20 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-25d7fe58-174f-455e-b404-8b091cc237f3 tempest-VolumesActionsTest-33188292 None] Image conversion details: src /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632, size 1024.00 MB, duration 11.35 sec, destination /opt/stack/data/cinder/conversion/a55e8d08-4354-4179-9609-260e26681632.temp_image.b150969e-e466-46a2-9579-3be09e86f209eiudx7e9.img {{(pid=86366) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 11:58:20 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-25d7fe58-174f-455e-b404-8b091cc237f3 tempest-VolumesActionsTest-33188292 None] Converted 1024.00 MB image at 90.24 MB/s Sep 21 11:58:20 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-25d7fe58-174f-455e-b404-8b091cc237f3 tempest-VolumesActionsTest-33188292 None] b150969e-e466-46a2-9579-3be09e86f209 was raw, no need to convert to raw {{(pid=86366) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 21 11:58:20 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:58:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Flow 'volume_create_manager' (dbce5d8f-c4c3-400a-af6e-2a5d4f24cdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:58:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7c3c77-df9b-4012-9f92-ed7b252dc32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7c3c77-df9b-4012-9f92-ed7b252dc32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-655934130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c851973e-4e75-4551-88f4-552f3ab35a68,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d330ad9bba040de828d279b99314ae3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:58:21Z,use_quota=True,user_id='100d4d7e11c84064baee824421314150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18e933ba-4865-4365-8ae2-f8436075fb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18e933ba-4865-4365-8ae2-f8436075fb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf92cf0-c144-402a-b7cb-2b9a51ae0d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf92cf0-c144-402a-b7cb-2b9a51ae0d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c851973e-4e75-4551-88f4-552f3ab35a68', 'volume_name': 'volume-c851973e-4e75-4551-88f4-552f3ab35a68', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87bb4380-e495-4d7e-bbc0-a2282f722e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87bb4380-e495-4d7e-bbc0-a2282f722e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a7f624e-d478-41f3-aa44-892f7297db18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:20 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Volume c851973e-4e75-4551-88f4-552f3ab35a68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c851973e-4e75-4551-88f4-552f3ab35a68', 'volume_size': 1} Sep 21 11:58:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:58:30 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:58:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Flow 'volume_create_manager' (b51f9703-d053-4862-85aa-f8db4f8a3f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:58:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec26d87c-f91f-4f3e-b59a-333ecba7fbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec26d87c-f91f-4f3e-b59a-333ecba7fbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1976004292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd0bfc1-2e9d-4f6f-8bdb-1bd534ca0c5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb8a5aa558841738d401c5208e20d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:58:30Z,use_quota=True,user_id='8014591b85c14e1899aff94058c3041a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3703e83-cd5f-4dbf-8982-4196722fa8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3703e83-cd5f-4dbf-8982-4196722fa8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d3e2a5-9224-476d-968a-ce65daa53612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d3e2a5-9224-476d-968a-ce65daa53612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bd0bfc1-2e9d-4f6f-8bdb-1bd534ca0c5e', 'volume_name': 'volume-8bd0bfc1-2e9d-4f6f-8bdb-1bd534ca0c5e', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f54a3ec-a35e-4e39-ac7d-c7252a044e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f54a3ec-a35e-4e39-ac7d-c7252a044e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d61ac5-2ca0-4f15-8362-c8a2a315a613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:30 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Volume 8bd0bfc1-2e9d-4f6f-8bdb-1bd534ca0c5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bd0bfc1-2e9d-4f6f-8bdb-1bd534ca0c5e', 'volume_size': 1} Sep 21 11:58:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:58:33 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:58:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Flow 'volume_create_manager' (121e28fe-1ec9-40fe-89e9-9810d02c4277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:58:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc154de-4614-4d50-8c2d-388b92757a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc154de-4614-4d50-8c2d-388b92757a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-130047151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20447cbf-801a-4be1-a7d5-fea9bca4d621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f981458b88f4481dbf41791072843dde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:58:33Z,use_quota=True,user_id='b9682decda0a4a8ea116986eaf616f3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bde156d-5d97-4f0e-a0b8-cbfbf86aa16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bde156d-5d97-4f0e-a0b8-cbfbf86aa16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d282aa-3d11-4553-aea7-ef9296d88d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d282aa-3d11-4553-aea7-ef9296d88d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20447cbf-801a-4be1-a7d5-fea9bca4d621', 'volume_name': 'volume-20447cbf-801a-4be1-a7d5-fea9bca4d621', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b23a79-cfd4-4a31-87e3-51a2a282c489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4b23a79-cfd4-4a31-87e3-51a2a282c489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28dd4a5-3f8b-4831-964a-dff63d75ffbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:33 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Volume 20447cbf-801a-4be1-a7d5-fea9bca4d621: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20447cbf-801a-4be1-a7d5-fea9bca4d621', 'volume_size': 1} Sep 21 11:58:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:58:43 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:58:43 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:58:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-25d7fe58-174f-455e-b404-8b091cc237f3 tempest-VolumesActionsTest-33188292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 37.522s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:58:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25d7fe58-174f-455e-b404-8b091cc237f3 tempest-VolumesActionsTest-33188292 None] Uploaded volume to glance image-id: b150969e-e466-46a2-9579-3be09e86f209. {{(pid=86366) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 21 11:58:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.702s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:58:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-655934130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c851973e-4e75-4551-88f4-552f3ab35a68,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5d330ad9bba040de828d279b99314ae3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:58:21Z,use_quota=True,user_id='100d4d7e11c84064baee824421314150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:58:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Creating volume c851973e-4e75-4551-88f4-552f3ab35a68 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:58:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:58:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:58:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:58:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:58:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:58:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:58:44 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:58:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c851973e-4e75-4551-88f4-552f3ab35a68 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:44 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c851973e-4e75-4551-88f4-552f3ab35a68 1073741824 Sep 21 11:58:44 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:44 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-25d7fe58-174f-455e-b404-8b091cc237f3 tempest-VolumesActionsTest-33188292 None] Copy volume to image completed successfully. Sep 21 11:58:44 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c851973e-4e75-4551-88f4-552f3ab35a68 1073741824" returned: 0 in 0.473s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c851973e-4e75-4551-88f4-552f3ab35a68 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:45 devstack sudo[96050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c851973e-4e75-4551-88f4-552f3ab35a68 Sep 21 11:58:45 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:45 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c851973e-4e75-4551-88f4-552f3ab35a68" returned: 0 in 0.284s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:58:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:58:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.931s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:58:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1976004292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd0bfc1-2e9d-4f6f-8bdb-1bd534ca0c5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb8a5aa558841738d401c5208e20d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:58:30Z,use_quota=True,user_id='8014591b85c14e1899aff94058c3041a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:58:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Creating volume 8bd0bfc1-2e9d-4f6f-8bdb-1bd534ca0c5e {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:58:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:58:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:58:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:58:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:58:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:58:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:58:45 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:58:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8bd0bfc1-2e9d-4f6f-8bdb-1bd534ca0c5e 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:45 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a7f624e-d478-41f3-aa44-892f7297db18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c851973e-4e75-4551-88f4-552f3ab35a68', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:45 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8bd0bfc1-2e9d-4f6f-8bdb-1bd534ca0c5e 1073741824 Sep 21 11:58:45 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:45 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5234d59f-2ae7-4cee-8799-806d012aabb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:45 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Volume volume-c851973e-4e75-4551-88f4-552f3ab35a68 (c851973e-4e75-4551-88f4-552f3ab35a68): created successfully Sep 21 11:58:45 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5234d59f-2ae7-4cee-8799-806d012aabb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:45 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Flow 'volume_create_manager' (dbce5d8f-c4c3-400a-af6e-2a5d4f24cdb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:58:45 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-2827f5a4-4300-4ca2-894d-15498b8ab1a6 req-1eacb7a7-5559-44f9-8ebe-fdc9aeddce4a tempest-VolumesGetTestJSON-1848731453 None] Created volume successfully. Sep 21 11:58:45 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8bd0bfc1-2e9d-4f6f-8bdb-1bd534ca0c5e 1073741824" returned: 0 in 0.513s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8bd0bfc1-2e9d-4f6f-8bdb-1bd534ca0c5e {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:45 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8bd0bfc1-2e9d-4f6f-8bdb-1bd534ca0c5e Sep 21 11:58:45 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3b276d69-d56c-45c2-89aa-1e7ced7f82eb tempest-VolumesActionsTest-33188292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:58:46 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8bd0bfc1-2e9d-4f6f-8bdb-1bd534ca0c5e" returned: 0 in 0.319s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:58:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:58:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.925s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:58:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-130047151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20447cbf-801a-4be1-a7d5-fea9bca4d621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f981458b88f4481dbf41791072843dde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:58:33Z,use_quota=True,user_id='b9682decda0a4a8ea116986eaf616f3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:58:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Creating volume 20447cbf-801a-4be1-a7d5-fea9bca4d621 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:58:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:58:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:58:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:58:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:58:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:58:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:58:46 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:58:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-20447cbf-801a-4be1-a7d5-fea9bca4d621 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:46 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-20447cbf-801a-4be1-a7d5-fea9bca4d621 1073741824 Sep 21 11:58:46 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d61ac5-2ca0-4f15-8362-c8a2a315a613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bd0bfc1-2e9d-4f6f-8bdb-1bd534ca0c5e', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d2ea7f-eb41-420e-b2e3-6922e8a14226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:46 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Volume volume-8bd0bfc1-2e9d-4f6f-8bdb-1bd534ca0c5e (8bd0bfc1-2e9d-4f6f-8bdb-1bd534ca0c5e): created successfully Sep 21 11:58:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d2ea7f-eb41-420e-b2e3-6922e8a14226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Flow 'volume_create_manager' (b51f9703-d053-4862-85aa-f8db4f8a3f2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:58:46 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-d19bd8b8-940b-471f-9aeb-f604e39b19a7 tempest-VolumesTransfersV355Test-1634604382 None] Created volume successfully. Sep 21 11:58:46 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-30ec00d0-d5a6-4fa3-8a40-ca6f1855d48e req-d2cba1dd-1361-4ed5-b464-a61db1205170 tempest-VolumesGetTestJSON-1848731453 None] Acquiring lock "cinder-c851973e-4e75-4551-88f4-552f3ab35a68-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:58:46 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-30ec00d0-d5a6-4fa3-8a40-ca6f1855d48e req-d2cba1dd-1361-4ed5-b464-a61db1205170 tempest-VolumesGetTestJSON-1848731453 None] Lock "cinder-c851973e-4e75-4551-88f4-552f3ab35a68-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:58:46 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-30ec00d0-d5a6-4fa3-8a40-ca6f1855d48e req-d2cba1dd-1361-4ed5-b464-a61db1205170 tempest-VolumesGetTestJSON-1848731453 None] Acquiring lock "cinder-quobyte-c851973e-4e75-4551-88f4-552f3ab35a68" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:58:46 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-30ec00d0-d5a6-4fa3-8a40-ca6f1855d48e req-d2cba1dd-1361-4ed5-b464-a61db1205170 tempest-VolumesGetTestJSON-1848731453 None] Lock "cinder-quobyte-c851973e-4e75-4551-88f4-552f3ab35a68" acquired by "delete_volume" :: waited 0.017s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:58:46 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4db1313-a250-402a-aec3-ffc08bb7a892]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:58:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-30ec00d0-d5a6-4fa3-8a40-ca6f1855d48e req-d2cba1dd-1361-4ed5-b464-a61db1205170 tempest-VolumesGetTestJSON-1848731453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c851973e-4e75-4551-88f4-552f3ab35a68 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:46 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-20447cbf-801a-4be1-a7d5-fea9bca4d621 1073741824" returned: 0 in 0.523s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-20447cbf-801a-4be1-a7d5-fea9bca4d621 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:46 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c851973e-4e75-4551-88f4-552f3ab35a68 Sep 21 11:58:46 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:46 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-20447cbf-801a-4be1-a7d5-fea9bca4d621 Sep 21 11:58:46 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:47 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-20447cbf-801a-4be1-a7d5-fea9bca4d621" returned: 0 in 0.287s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:47 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:58:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:58:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3b276d69-d56c-45c2-89aa-1e7ced7f82eb tempest-VolumesActionsTest-33188292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.880s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:58:47 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28dd4a5-3f8b-4831-964a-dff63d75ffbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20447cbf-801a-4be1-a7d5-fea9bca4d621', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:47 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e19895-ec5a-4011-b13a-70f7f602f1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:47 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a51f86-e3a2-422f-8ab8-1c90bf94a226]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:58:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3b276d69-d56c-45c2-89aa-1e7ced7f82eb tempest-VolumesActionsTest-33188292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:47 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Volume volume-20447cbf-801a-4be1-a7d5-fea9bca4d621 (20447cbf-801a-4be1-a7d5-fea9bca4d621): created successfully Sep 21 11:58:47 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:47 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13e19895-ec5a-4011-b13a-70f7f602f1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:47 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Flow 'volume_create_manager' (121e28fe-1ec9-40fe-89e9-9810d02c4277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:58:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-30ec00d0-d5a6-4fa3-8a40-ca6f1855d48e req-d2cba1dd-1361-4ed5-b464-a61db1205170 tempest-VolumesGetTestJSON-1848731453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c851973e-4e75-4551-88f4-552f3ab35a68" returned: 0 in 0.457s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-30ec00d0-d5a6-4fa3-8a40-ca6f1855d48e req-d2cba1dd-1361-4ed5-b464-a61db1205170 tempest-VolumesGetTestJSON-1848731453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c851973e-4e75-4551-88f4-552f3ab35a68 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:47 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-6c341995-13bf-4abb-9253-ee396734aee7 tempest-ServersNegativeTestJSON-1565159876 None] Created volume successfully. Sep 21 11:58:47 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c851973e-4e75-4551-88f4-552f3ab35a68 Sep 21 11:58:47 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:47 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632 Sep 21 11:58:47 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:47 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-30ec00d0-d5a6-4fa3-8a40-ca6f1855d48e req-d2cba1dd-1361-4ed5-b464-a61db1205170 tempest-VolumesGetTestJSON-1848731453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c851973e-4e75-4551-88f4-552f3ab35a68" returned: 0 in 0.280s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-30ec00d0-d5a6-4fa3-8a40-ca6f1855d48e req-d2cba1dd-1361-4ed5-b464-a61db1205170 tempest-VolumesGetTestJSON-1848731453 None] Lock "cinder-quobyte-c851973e-4e75-4551-88f4-552f3ab35a68" released by "delete_volume" :: held 0.786s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:58:47 devstack cinder-volume[86366]: DEBUG cinder.quota [req-30ec00d0-d5a6-4fa3-8a40-ca6f1855d48e req-d2cba1dd-1361-4ed5-b464-a61db1205170 tempest-VolumesGetTestJSON-1848731453 None] Created reservations ['4ac1cf51-368d-4534-b7f9-80a9ad8a0cda', 'e79ef7f7-bb8e-417e-ade5-e5a93724a220', 'f12baa28-f54c-4a2c-a8aa-f499dcd073d1', 'b2492e82-b70b-4bcd-bdb2-4e10996af706'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:58:47 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3b276d69-d56c-45c2-89aa-1e7ced7f82eb tempest-VolumesActionsTest-33188292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632" returned: 0 in 0.457s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-30ec00d0-d5a6-4fa3-8a40-ca6f1855d48e req-d2cba1dd-1361-4ed5-b464-a61db1205170 tempest-VolumesGetTestJSON-1848731453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:58:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-30ec00d0-d5a6-4fa3-8a40-ca6f1855d48e req-d2cba1dd-1361-4ed5-b464-a61db1205170 tempest-VolumesGetTestJSON-1848731453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:58:47 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [req-30ec00d0-d5a6-4fa3-8a40-ca6f1855d48e req-d2cba1dd-1361-4ed5-b464-a61db1205170 tempest-VolumesGetTestJSON-1848731453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:58:47 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [req-30ec00d0-d5a6-4fa3-8a40-ca6f1855d48e req-d2cba1dd-1361-4ed5-b464-a61db1205170 tempest-VolumesGetTestJSON-1848731453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:58:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-30ec00d0-d5a6-4fa3-8a40-ca6f1855d48e req-d2cba1dd-1361-4ed5-b464-a61db1205170 tempest-VolumesGetTestJSON-1848731453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:58:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-30ec00d0-d5a6-4fa3-8a40-ca6f1855d48e req-d2cba1dd-1361-4ed5-b464-a61db1205170 tempest-VolumesGetTestJSON-1848731453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:47 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[c128728a-36f1-4c1b-a936-8f2ab16d901e]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:58:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3b276d69-d56c-45c2-89aa-1e7ced7f82eb tempest-VolumesActionsTest-33188292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:47 devstack sudo[96084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:58:47 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:47 devstack sudo[96085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632 Sep 21 11:58:47 devstack sudo[96085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:47 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-30ec00d0-d5a6-4fa3-8a40-ca6f1855d48e req-d2cba1dd-1361-4ed5-b464-a61db1205170 tempest-VolumesGetTestJSON-1848731453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.297s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:47 devstack cinder-volume[86366]: DEBUG cinder.manager [req-30ec00d0-d5a6-4fa3-8a40-ca6f1855d48e req-d2cba1dd-1361-4ed5-b464-a61db1205170 tempest-VolumesGetTestJSON-1848731453 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:58:47 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-30ec00d0-d5a6-4fa3-8a40-ca6f1855d48e req-d2cba1dd-1361-4ed5-b464-a61db1205170 tempest-VolumesGetTestJSON-1848731453 None] Deleted volume successfully. Sep 21 11:58:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-30ec00d0-d5a6-4fa3-8a40-ca6f1855d48e req-d2cba1dd-1361-4ed5-b464-a61db1205170 tempest-VolumesGetTestJSON-1848731453 None] Lock "cinder-c851973e-4e75-4551-88f4-552f3ab35a68-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:58:48 devstack sudo[96085]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3b276d69-d56c-45c2-89aa-1e7ced7f82eb tempest-VolumesActionsTest-33188292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632" returned: 0 in 0.533s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3b276d69-d56c-45c2-89aa-1e7ced7f82eb tempest-VolumesActionsTest-33188292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632 /opt/stack/data/cinder/conversion/a55e8d08-4354-4179-9609-260e26681632.temp_image.f9d1a766-7af1-4c87-b38e-f0998973fbb93tcw845a.img {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:48 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632 /opt/stack/data/cinder/conversion/a55e8d08-4354-4179-9609-260e26681632.temp_image.f9d1a766-7af1-4c87-b38e-f0998973fbb93tcw845a.img Sep 21 11:58:48 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:49 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-58d2c0e2-7f2a-4430-8b16-c6c48af24428 tempest-VolumesTransfersV355Test-288937684 None] Transfer volume completed successfully. Sep 21 11:58:50 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:58:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Flow 'volume_create_manager' (9e7c518d-c8ab-4268-84b6-8ebf84cab312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:58:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec0af0c-49e9-4f15-8085-615f8a92fc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec0af0c-49e9-4f15-8085-615f8a92fc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-738322788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40fe64e2-ecdf-4eab-bc8f-734570d2b413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f981458b88f4481dbf41791072843dde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:58:50Z,use_quota=True,user_id='b9682decda0a4a8ea116986eaf616f3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd7fcad0-dd52-47b7-a0ba-1e376c4a43e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd7fcad0-dd52-47b7-a0ba-1e376c4a43e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0094abc2-c1ad-471d-a95c-eadfec659d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0094abc2-c1ad-471d-a95c-eadfec659d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40fe64e2-ecdf-4eab-bc8f-734570d2b413', 'volume_name': 'volume-40fe64e2-ecdf-4eab-bc8f-734570d2b413', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51764e83-3825-4f68-ba04-d5371a40ec54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51764e83-3825-4f68-ba04-d5371a40ec54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af28ae9a-fad5-4c7d-a139-85092727faa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:50 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Volume 40fe64e2-ecdf-4eab-bc8f-734570d2b413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40fe64e2-ecdf-4eab-bc8f-734570d2b413', 'volume_size': 1} Sep 21 11:58:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:58:50 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5394c592-d944-46e7-b1b6-2f2432fe9137 tempest-VolumesTransfersV355Test-216513733 None] Acquiring lock "cinder-8bd0bfc1-2e9d-4f6f-8bdb-1bd534ca0c5e-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:58:50 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5394c592-d944-46e7-b1b6-2f2432fe9137 tempest-VolumesTransfersV355Test-216513733 None] Lock "cinder-8bd0bfc1-2e9d-4f6f-8bdb-1bd534ca0c5e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:58:50 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5394c592-d944-46e7-b1b6-2f2432fe9137 tempest-VolumesTransfersV355Test-216513733 None] Acquiring lock "cinder-quobyte-8bd0bfc1-2e9d-4f6f-8bdb-1bd534ca0c5e" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:58:50 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5394c592-d944-46e7-b1b6-2f2432fe9137 tempest-VolumesTransfersV355Test-216513733 None] Lock "cinder-quobyte-8bd0bfc1-2e9d-4f6f-8bdb-1bd534ca0c5e" acquired by "delete_volume" :: waited 0.043s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:58:51 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1598c5-0170-4245-9503-a2de3e8a780b]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:58:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5394c592-d944-46e7-b1b6-2f2432fe9137 tempest-VolumesTransfersV355Test-216513733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8bd0bfc1-2e9d-4f6f-8bdb-1bd534ca0c5e {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:51 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8bd0bfc1-2e9d-4f6f-8bdb-1bd534ca0c5e Sep 21 11:58:51 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:51 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5394c592-d944-46e7-b1b6-2f2432fe9137 tempest-VolumesTransfersV355Test-216513733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8bd0bfc1-2e9d-4f6f-8bdb-1bd534ca0c5e" returned: 0 in 0.938s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5394c592-d944-46e7-b1b6-2f2432fe9137 tempest-VolumesTransfersV355Test-216513733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8bd0bfc1-2e9d-4f6f-8bdb-1bd534ca0c5e {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:52 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8bd0bfc1-2e9d-4f6f-8bdb-1bd534ca0c5e Sep 21 11:58:52 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:52 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5394c592-d944-46e7-b1b6-2f2432fe9137 tempest-VolumesTransfersV355Test-216513733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8bd0bfc1-2e9d-4f6f-8bdb-1bd534ca0c5e" returned: 0 in 0.661s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:52 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5394c592-d944-46e7-b1b6-2f2432fe9137 tempest-VolumesTransfersV355Test-216513733 None] Lock "cinder-quobyte-8bd0bfc1-2e9d-4f6f-8bdb-1bd534ca0c5e" released by "delete_volume" :: held 1.721s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:58:52 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-5394c592-d944-46e7-b1b6-2f2432fe9137 tempest-VolumesTransfersV355Test-216513733 None] Created reservations ['69243b5d-4978-4ba8-a1ba-910fc5fbf407', '65d2352e-213c-415c-8500-7a51eeced654', 'a29fa147-13dd-4f66-b217-6c022c2f2e3b', '604bd507-2f11-4f37-85ee-dccf99df56ab'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:58:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5394c592-d944-46e7-b1b6-2f2432fe9137 tempest-VolumesTransfersV355Test-216513733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:58:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5394c592-d944-46e7-b1b6-2f2432fe9137 tempest-VolumesTransfersV355Test-216513733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:58:53 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5394c592-d944-46e7-b1b6-2f2432fe9137 tempest-VolumesTransfersV355Test-216513733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:58:53 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5394c592-d944-46e7-b1b6-2f2432fe9137 tempest-VolumesTransfersV355Test-216513733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:58:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5394c592-d944-46e7-b1b6-2f2432fe9137 tempest-VolumesTransfersV355Test-216513733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:58:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5394c592-d944-46e7-b1b6-2f2432fe9137 tempest-VolumesTransfersV355Test-216513733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:53 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:58:53 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:53 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5394c592-d944-46e7-b1b6-2f2432fe9137 tempest-VolumesTransfersV355Test-216513733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.404s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:53 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-5394c592-d944-46e7-b1b6-2f2432fe9137 tempest-VolumesTransfersV355Test-216513733 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:58:53 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-5394c592-d944-46e7-b1b6-2f2432fe9137 tempest-VolumesTransfersV355Test-216513733 None] Deleted volume successfully. Sep 21 11:58:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5394c592-d944-46e7-b1b6-2f2432fe9137 tempest-VolumesTransfersV355Test-216513733 None] Lock "cinder-8bd0bfc1-2e9d-4f6f-8bdb-1bd534ca0c5e-delete_volume" released by "delete_volume" :: held 2.707s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:58:54 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:58:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Flow 'volume_create_manager' (ace18290-2958-46dd-ab23-55dae0c1bce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:58:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89dcc5fa-34bc-4e83-8355-a023034e51c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89dcc5fa-34bc-4e83-8355-a023034e51c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-10597607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376c4d02-bcbc-4dd7-bd5c-954c6c708d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb8a5aa558841738d401c5208e20d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:58:54Z,use_quota=True,user_id='8014591b85c14e1899aff94058c3041a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c018eaae-bb6d-4580-b43b-e6f3a0d76771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c018eaae-bb6d-4580-b43b-e6f3a0d76771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5afc08b-6262-4128-9e2f-397da2fd6620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5afc08b-6262-4128-9e2f-397da2fd6620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '376c4d02-bcbc-4dd7-bd5c-954c6c708d93', 'volume_name': 'volume-376c4d02-bcbc-4dd7-bd5c-954c6c708d93', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23811fe0-7fd5-406e-b393-ccad71cb3762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23811fe0-7fd5-406e-b393-ccad71cb3762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:58:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea8ad69-31fe-4084-b4bf-e046299f39d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:58:54 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Volume 376c4d02-bcbc-4dd7-bd5c-954c6c708d93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-376c4d02-bcbc-4dd7-bd5c-954c6c708d93', 'volume_size': 1} Sep 21 11:58:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:58:56 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3b276d69-d56c-45c2-89aa-1e7ced7f82eb tempest-VolumesActionsTest-33188292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632 /opt/stack/data/cinder/conversion/a55e8d08-4354-4179-9609-260e26681632.temp_image.f9d1a766-7af1-4c87-b38e-f0998973fbb93tcw845a.img" returned: 0 in 8.589s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:56 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed40f140-0087-4678-9ec0-edb49a743ed5]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:58:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3b276d69-d56c-45c2-89aa-1e7ced7f82eb tempest-VolumesActionsTest-33188292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:56 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632 Sep 21 11:58:56 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:57 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3b276d69-d56c-45c2-89aa-1e7ced7f82eb tempest-VolumesActionsTest-33188292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632" returned: 0 in 0.562s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:57 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-3b276d69-d56c-45c2-89aa-1e7ced7f82eb tempest-VolumesActionsTest-33188292 None] Image conversion details: src /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632, size 1024.00 MB, duration 8.59 sec, destination /opt/stack/data/cinder/conversion/a55e8d08-4354-4179-9609-260e26681632.temp_image.f9d1a766-7af1-4c87-b38e-f0998973fbb93tcw845a.img {{(pid=86366) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 11:58:57 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-3b276d69-d56c-45c2-89aa-1e7ced7f82eb tempest-VolumesActionsTest-33188292 None] Converted 1024.00 MB image at 119.21 MB/s Sep 21 11:58:57 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-3b276d69-d56c-45c2-89aa-1e7ced7f82eb tempest-VolumesActionsTest-33188292 None] f9d1a766-7af1-4c87-b38e-f0998973fbb9 was raw, converting to qcow2 {{(pid=86366) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 21 11:58:57 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9db24c-df2b-4d3a-a6fc-60204d0ccc0b]: (4, 'raw') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:58:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3b276d69-d56c-45c2-89aa-1e7ced7f82eb tempest-VolumesActionsTest-33188292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a55e8d08-4354-4179-9609-260e26681632.temp_image.f9d1a766-7af1-4c87-b38e-f0998973fbb93tcw845a.img {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:57 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a55e8d08-4354-4179-9609-260e26681632.temp_image.f9d1a766-7af1-4c87-b38e-f0998973fbb93tcw845a.img Sep 21 11:58:57 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:57 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3b276d69-d56c-45c2-89aa-1e7ced7f82eb tempest-VolumesActionsTest-33188292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a55e8d08-4354-4179-9609-260e26681632.temp_image.f9d1a766-7af1-4c87-b38e-f0998973fbb93tcw845a.img" returned: 0 in 0.328s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3b276d69-d56c-45c2-89aa-1e7ced7f82eb tempest-VolumesActionsTest-33188292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a55e8d08-4354-4179-9609-260e26681632.temp_image.f9d1a766-7af1-4c87-b38e-f0998973fbb93tcw845a.img {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:57 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a55e8d08-4354-4179-9609-260e26681632.temp_image.f9d1a766-7af1-4c87-b38e-f0998973fbb93tcw845a.img Sep 21 11:58:57 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:57 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3b276d69-d56c-45c2-89aa-1e7ced7f82eb tempest-VolumesActionsTest-33188292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a55e8d08-4354-4179-9609-260e26681632.temp_image.f9d1a766-7af1-4c87-b38e-f0998973fbb93tcw845a.img" returned: 1 in 0.337s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3b276d69-d56c-45c2-89aa-1e7ced7f82eb tempest-VolumesActionsTest-33188292 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a55e8d08-4354-4179-9609-260e26681632.temp_image.f9d1a766-7af1-4c87-b38e-f0998973fbb93tcw845a.img' failed. Not Retrying. {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 11:58:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3b276d69-d56c-45c2-89aa-1e7ced7f82eb tempest-VolumesActionsTest-33188292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a55e8d08-4354-4179-9609-260e26681632.temp_image.f9d1a766-7af1-4c87-b38e-f0998973fbb93tcw845a.img /opt/stack/data/cinder/conversion/vol_upload__d7swg1d {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:58 devstack sudo[96177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a55e8d08-4354-4179-9609-260e26681632.temp_image.f9d1a766-7af1-4c87-b38e-f0998973fbb93tcw845a.img /opt/stack/data/cinder/conversion/vol_upload__d7swg1d Sep 21 11:58:58 devstack sudo[96177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:58 devstack sudo[96177]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3b276d69-d56c-45c2-89aa-1e7ced7f82eb tempest-VolumesActionsTest-33188292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a55e8d08-4354-4179-9609-260e26681632.temp_image.f9d1a766-7af1-4c87-b38e-f0998973fbb93tcw845a.img /opt/stack/data/cinder/conversion/vol_upload__d7swg1d" returned: 0 in 0.285s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:58:58 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-3b276d69-d56c-45c2-89aa-1e7ced7f82eb tempest-VolumesActionsTest-33188292 None] Image conversion details: src /opt/stack/data/cinder/conversion/a55e8d08-4354-4179-9609-260e26681632.temp_image.f9d1a766-7af1-4c87-b38e-f0998973fbb93tcw845a.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload__d7swg1d {{(pid=86366) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 11:58:58 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-3b276d69-d56c-45c2-89aa-1e7ced7f82eb tempest-VolumesActionsTest-33188292 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 21 11:58:58 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f1eb5e-f159-4c52-94db-50a8e17d2333]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:58:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3b276d69-d56c-45c2-89aa-1e7ced7f82eb tempest-VolumesActionsTest-33188292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__d7swg1d {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:58:58 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__d7swg1d Sep 21 11:58:58 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:58:58 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Sep 21 11:58:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3b276d69-d56c-45c2-89aa-1e7ced7f82eb tempest-VolumesActionsTest-33188292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__d7swg1d" returned: 0 in 0.334s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3b276d69-d56c-45c2-89aa-1e7ced7f82eb tempest-VolumesActionsTest-33188292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.155s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3b276d69-d56c-45c2-89aa-1e7ced7f82eb tempest-VolumesActionsTest-33188292 None] Uploaded volume to glance image-id: f9d1a766-7af1-4c87-b38e-f0998973fbb9. {{(pid=86366) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 21 11:59:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.437s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-738322788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40fe64e2-ecdf-4eab-bc8f-734570d2b413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f981458b88f4481dbf41791072843dde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:58:50Z,use_quota=True,user_id='b9682decda0a4a8ea116986eaf616f3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:59:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Creating volume 40fe64e2-ecdf-4eab-bc8f-734570d2b413 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:59:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:59:00 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:59:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-40fe64e2-ecdf-4eab-bc8f-734570d2b413 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:00 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-3b276d69-d56c-45c2-89aa-1e7ced7f82eb tempest-VolumesActionsTest-33188292 None] Copy volume to image completed successfully. Sep 21 11:59:00 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-40fe64e2-ecdf-4eab-bc8f-734570d2b413 1073741824 Sep 21 11:59:00 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:00 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-40fe64e2-ecdf-4eab-bc8f-734570d2b413 1073741824" returned: 0 in 0.479s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-40fe64e2-ecdf-4eab-bc8f-734570d2b413 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:00 devstack sudo[96202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-40fe64e2-ecdf-4eab-bc8f-734570d2b413 Sep 21 11:59:00 devstack sudo[96202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:01 devstack sudo[96202]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-40fe64e2-ecdf-4eab-bc8f-734570d2b413" returned: 0 in 0.271s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:59:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.351s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-10597607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376c4d02-bcbc-4dd7-bd5c-954c6c708d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb8a5aa558841738d401c5208e20d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:58:54Z,use_quota=True,user_id='8014591b85c14e1899aff94058c3041a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:59:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Creating volume 376c4d02-bcbc-4dd7-bd5c-954c6c708d93 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:59:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:59:01 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:59:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-376c4d02-bcbc-4dd7-bd5c-954c6c708d93 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:01 devstack sudo[96205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-376c4d02-bcbc-4dd7-bd5c-954c6c708d93 1073741824 Sep 21 11:59:01 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af28ae9a-fad5-4c7d-a139-85092727faa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40fe64e2-ecdf-4eab-bc8f-734570d2b413', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a6d607-7917-4571-af0a-6a5eab4b9673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:01 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Volume volume-40fe64e2-ecdf-4eab-bc8f-734570d2b413 (40fe64e2-ecdf-4eab-bc8f-734570d2b413): created successfully Sep 21 11:59:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28a6d607-7917-4571-af0a-6a5eab4b9673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Flow 'volume_create_manager' (9e7c518d-c8ab-4268-84b6-8ebf84cab312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:59:01 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-311a5d62-5454-4825-80fb-d6819f9965e9 tempest-ServersNegativeTestJSON-1565159876 None] Created volume successfully. Sep 21 11:59:01 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-376c4d02-bcbc-4dd7-bd5c-954c6c708d93 1073741824" returned: 0 in 0.502s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-376c4d02-bcbc-4dd7-bd5c-954c6c708d93 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:01 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-376c4d02-bcbc-4dd7-bd5c-954c6c708d93 Sep 21 11:59:01 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:01 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c6653a0c-7301-408c-97da-0318ff18ea28 tempest-VolumesActionsTest-33188292 None] Acquiring lock "cinder-a55e8d08-4354-4179-9609-260e26681632-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:02 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c6653a0c-7301-408c-97da-0318ff18ea28 tempest-VolumesActionsTest-33188292 None] Lock "cinder-a55e8d08-4354-4179-9609-260e26681632-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:02 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c6653a0c-7301-408c-97da-0318ff18ea28 tempest-VolumesActionsTest-33188292 None] Acquiring lock "cinder-quobyte-a55e8d08-4354-4179-9609-260e26681632" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:02 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c6653a0c-7301-408c-97da-0318ff18ea28 tempest-VolumesActionsTest-33188292 None] Lock "cinder-quobyte-a55e8d08-4354-4179-9609-260e26681632" acquired by "delete_volume" :: waited 0.024s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:02 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-376c4d02-bcbc-4dd7-bd5c-954c6c708d93" returned: 0 in 0.381s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:59:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ea8ad69-31fe-4084-b4bf-e046299f39d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-376c4d02-bcbc-4dd7-bd5c-954c6c708d93', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f53b14-4e95-4571-9123-0dd54444cafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:02 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b316687-c028-4a54-b553-beed4b545d5b]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c6653a0c-7301-408c-97da-0318ff18ea28 tempest-VolumesActionsTest-33188292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:02 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Volume volume-376c4d02-bcbc-4dd7-bd5c-954c6c708d93 (376c4d02-bcbc-4dd7-bd5c-954c6c708d93): created successfully Sep 21 11:59:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6f53b14-4e95-4571-9123-0dd54444cafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Flow 'volume_create_manager' (ace18290-2958-46dd-ab23-55dae0c1bce2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:59:02 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-e2a35290-1cd8-43ef-bd3c-89b4e43f23ee tempest-VolumesTransfersV355Test-1634604382 None] Created volume successfully. Sep 21 11:59:02 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f7d5776f-ab4e-4f7c-91e6-0d98e35fc941 tempest-ServersNegativeTestJSON-1565159876 None] Acquiring lock "cinder-40fe64e2-ecdf-4eab-bc8f-734570d2b413-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:02 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f7d5776f-ab4e-4f7c-91e6-0d98e35fc941 tempest-ServersNegativeTestJSON-1565159876 None] Lock "cinder-40fe64e2-ecdf-4eab-bc8f-734570d2b413-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:02 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632 Sep 21 11:59:02 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:02 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f7d5776f-ab4e-4f7c-91e6-0d98e35fc941 tempest-ServersNegativeTestJSON-1565159876 None] Acquiring lock "cinder-quobyte-40fe64e2-ecdf-4eab-bc8f-734570d2b413" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:02 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f7d5776f-ab4e-4f7c-91e6-0d98e35fc941 tempest-ServersNegativeTestJSON-1565159876 None] Lock "cinder-quobyte-40fe64e2-ecdf-4eab-bc8f-734570d2b413" acquired by "delete_volume" :: waited 0.015s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:02 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb961a10-dfff-4c5b-9e54-84ee8fe7a96c]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f7d5776f-ab4e-4f7c-91e6-0d98e35fc941 tempest-ServersNegativeTestJSON-1565159876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-40fe64e2-ecdf-4eab-bc8f-734570d2b413 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:02 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-40fe64e2-ecdf-4eab-bc8f-734570d2b413 Sep 21 11:59:02 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:02 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c6653a0c-7301-408c-97da-0318ff18ea28 tempest-VolumesActionsTest-33188292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632" returned: 0 in 0.444s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c6653a0c-7301-408c-97da-0318ff18ea28 tempest-VolumesActionsTest-33188292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:02 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632 Sep 21 11:59:02 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:02 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f7d5776f-ab4e-4f7c-91e6-0d98e35fc941 tempest-ServersNegativeTestJSON-1565159876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-40fe64e2-ecdf-4eab-bc8f-734570d2b413" returned: 0 in 0.413s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f7d5776f-ab4e-4f7c-91e6-0d98e35fc941 tempest-ServersNegativeTestJSON-1565159876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-40fe64e2-ecdf-4eab-bc8f-734570d2b413 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:02 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-40fe64e2-ecdf-4eab-bc8f-734570d2b413 Sep 21 11:59:02 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:02 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c6653a0c-7301-408c-97da-0318ff18ea28 tempest-VolumesActionsTest-33188292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a55e8d08-4354-4179-9609-260e26681632" returned: 0 in 0.288s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:02 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c6653a0c-7301-408c-97da-0318ff18ea28 tempest-VolumesActionsTest-33188292 None] Lock "cinder-quobyte-a55e8d08-4354-4179-9609-260e26681632" released by "delete_volume" :: held 0.801s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:02 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-c6653a0c-7301-408c-97da-0318ff18ea28 tempest-VolumesActionsTest-33188292 None] Created reservations ['c6b9556b-d073-40bc-b2a5-5a664c504b45', 'bf148050-bab0-4ce2-8f2b-04bf4ebf93c7', '8c508123-64c0-437f-8ad0-6095e9079a1e', 'b2713f6c-2a66-4b66-aaf8-8a81ef5d4b25'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c6653a0c-7301-408c-97da-0318ff18ea28 tempest-VolumesActionsTest-33188292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c6653a0c-7301-408c-97da-0318ff18ea28 tempest-VolumesActionsTest-33188292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c6653a0c-7301-408c-97da-0318ff18ea28 tempest-VolumesActionsTest-33188292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c6653a0c-7301-408c-97da-0318ff18ea28 tempest-VolumesActionsTest-33188292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c6653a0c-7301-408c-97da-0318ff18ea28 tempest-VolumesActionsTest-33188292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c6653a0c-7301-408c-97da-0318ff18ea28 tempest-VolumesActionsTest-33188292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:03 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:59:03 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:03 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f7d5776f-ab4e-4f7c-91e6-0d98e35fc941 tempest-ServersNegativeTestJSON-1565159876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-40fe64e2-ecdf-4eab-bc8f-734570d2b413" returned: 0 in 0.307s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f7d5776f-ab4e-4f7c-91e6-0d98e35fc941 tempest-ServersNegativeTestJSON-1565159876 None] Lock "cinder-quobyte-40fe64e2-ecdf-4eab-bc8f-734570d2b413" released by "delete_volume" :: held 0.775s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-f7d5776f-ab4e-4f7c-91e6-0d98e35fc941 tempest-ServersNegativeTestJSON-1565159876 None] Created reservations ['b9e2e163-87a1-4fa1-95fb-9a45e7f30631', 'dc5ab991-8806-45c5-8497-a91233189dfa', 'cfc032ca-32ae-4a33-b0d9-1bcb71537cc8', 'bb36758a-4cdf-4120-af07-8833b27881c4'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f7d5776f-ab4e-4f7c-91e6-0d98e35fc941 tempest-ServersNegativeTestJSON-1565159876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f7d5776f-ab4e-4f7c-91e6-0d98e35fc941 tempest-ServersNegativeTestJSON-1565159876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f7d5776f-ab4e-4f7c-91e6-0d98e35fc941 tempest-ServersNegativeTestJSON-1565159876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f7d5776f-ab4e-4f7c-91e6-0d98e35fc941 tempest-ServersNegativeTestJSON-1565159876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f7d5776f-ab4e-4f7c-91e6-0d98e35fc941 tempest-ServersNegativeTestJSON-1565159876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f7d5776f-ab4e-4f7c-91e6-0d98e35fc941 tempest-ServersNegativeTestJSON-1565159876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:03 devstack sudo[96231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:59:03 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:03 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c6653a0c-7301-408c-97da-0318ff18ea28 tempest-VolumesActionsTest-33188292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.402s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-c6653a0c-7301-408c-97da-0318ff18ea28 tempest-VolumesActionsTest-33188292 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:59:03 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-c6653a0c-7301-408c-97da-0318ff18ea28 tempest-VolumesActionsTest-33188292 None] Deleted volume successfully. Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c6653a0c-7301-408c-97da-0318ff18ea28 tempest-VolumesActionsTest-33188292 None] Lock "cinder-a55e8d08-4354-4179-9609-260e26681632-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b4b9a76d-3013-4a04-83ae-aeb5e421680f tempest-ServersNegativeTestJSON-1565159876 None] Acquiring lock "cinder-20447cbf-801a-4be1-a7d5-fea9bca4d621-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b4b9a76d-3013-4a04-83ae-aeb5e421680f tempest-ServersNegativeTestJSON-1565159876 None] Lock "cinder-20447cbf-801a-4be1-a7d5-fea9bca4d621-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:03 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f7d5776f-ab4e-4f7c-91e6-0d98e35fc941 tempest-ServersNegativeTestJSON-1565159876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.336s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-f7d5776f-ab4e-4f7c-91e6-0d98e35fc941 tempest-ServersNegativeTestJSON-1565159876 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:59:03 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-f7d5776f-ab4e-4f7c-91e6-0d98e35fc941 tempest-ServersNegativeTestJSON-1565159876 None] Deleted volume successfully. Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b4b9a76d-3013-4a04-83ae-aeb5e421680f tempest-ServersNegativeTestJSON-1565159876 None] Acquiring lock "cinder-quobyte-20447cbf-801a-4be1-a7d5-fea9bca4d621" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:03 devstack sudo[96235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:59:03 devstack sudo[96235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f7d5776f-ab4e-4f7c-91e6-0d98e35fc941 tempest-ServersNegativeTestJSON-1565159876 None] Lock "cinder-40fe64e2-ecdf-4eab-bc8f-734570d2b413-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b4b9a76d-3013-4a04-83ae-aeb5e421680f tempest-ServersNegativeTestJSON-1565159876 None] Lock "cinder-quobyte-20447cbf-801a-4be1-a7d5-fea9bca4d621" acquired by "delete_volume" :: waited 0.038s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9425e58-105a-4219-bea3-45dd4c53012e]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b4b9a76d-3013-4a04-83ae-aeb5e421680f tempest-ServersNegativeTestJSON-1565159876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-20447cbf-801a-4be1-a7d5-fea9bca4d621 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:03 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a65e3e56-7857-4c0b-a142-12b45ccd56fb tempest-VolumesTransfersV355Test-216513733 None] Acquiring lock "cinder-376c4d02-bcbc-4dd7-bd5c-954c6c708d93-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:03 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-20447cbf-801a-4be1-a7d5-fea9bca4d621 Sep 21 11:59:03 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:04 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a65e3e56-7857-4c0b-a142-12b45ccd56fb tempest-VolumesTransfersV355Test-216513733 None] Lock "cinder-376c4d02-bcbc-4dd7-bd5c-954c6c708d93-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:04 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a65e3e56-7857-4c0b-a142-12b45ccd56fb tempest-VolumesTransfersV355Test-216513733 None] Acquiring lock "cinder-quobyte-376c4d02-bcbc-4dd7-bd5c-954c6c708d93" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:04 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a65e3e56-7857-4c0b-a142-12b45ccd56fb tempest-VolumesTransfersV355Test-216513733 None] Lock "cinder-quobyte-376c4d02-bcbc-4dd7-bd5c-954c6c708d93" acquired by "delete_volume" :: waited 0.052s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:04 devstack sudo[96235]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.497s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:04 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:59:04 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 11:59:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread count: 28 {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 11:59:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread info: [<_MainThread(MainThread, started 132841976594560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 11:59:04 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b1023c-37f4-4280-921a-364a2c69ddd4]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a65e3e56-7857-4c0b-a142-12b45ccd56fb tempest-VolumesTransfersV355Test-216513733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-376c4d02-bcbc-4dd7-bd5c-954c6c708d93 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:04 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1c964651-508e-4a1c-a841-f885d8c4dccb tempest-GroupsTest-1078100098 None] Group tempest-Group1-1869311140: creating Sep 21 11:59:04 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1c964651-508e-4a1c-a841-f885d8c4dccb tempest-GroupsTest-1078100098 None] Group tempest-Group1-1869311140: created successfully Sep 21 11:59:04 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1c964651-508e-4a1c-a841-f885d8c4dccb tempest-GroupsTest-1078100098 None] Create group completed successfully. Sep 21 11:59:04 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:04 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-376c4d02-bcbc-4dd7-bd5c-954c6c708d93 Sep 21 11:59:04 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b4b9a76d-3013-4a04-83ae-aeb5e421680f tempest-ServersNegativeTestJSON-1565159876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-20447cbf-801a-4be1-a7d5-fea9bca4d621" returned: 0 in 0.545s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b4b9a76d-3013-4a04-83ae-aeb5e421680f tempest-ServersNegativeTestJSON-1565159876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-20447cbf-801a-4be1-a7d5-fea9bca4d621 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:04 devstack sudo[96245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-20447cbf-801a-4be1-a7d5-fea9bca4d621 Sep 21 11:59:04 devstack sudo[96245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:04 devstack sudo[96245]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b4b9a76d-3013-4a04-83ae-aeb5e421680f tempest-ServersNegativeTestJSON-1565159876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-20447cbf-801a-4be1-a7d5-fea9bca4d621" returned: 0 in 0.288s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:04 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b4b9a76d-3013-4a04-83ae-aeb5e421680f tempest-ServersNegativeTestJSON-1565159876 None] Lock "cinder-quobyte-20447cbf-801a-4be1-a7d5-fea9bca4d621" released by "delete_volume" :: held 0.922s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:04 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a65e3e56-7857-4c0b-a142-12b45ccd56fb tempest-VolumesTransfersV355Test-216513733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-376c4d02-bcbc-4dd7-bd5c-954c6c708d93" returned: 0 in 0.477s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a65e3e56-7857-4c0b-a142-12b45ccd56fb tempest-VolumesTransfersV355Test-216513733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-376c4d02-bcbc-4dd7-bd5c-954c6c708d93 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:04 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-376c4d02-bcbc-4dd7-bd5c-954c6c708d93 Sep 21 11:59:04 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:04 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-b4b9a76d-3013-4a04-83ae-aeb5e421680f tempest-ServersNegativeTestJSON-1565159876 None] Created reservations ['00060430-22ae-4eb9-a10b-46ba8b6c3f73', '96f943fd-0dc1-492e-ba3f-85ef6c577bf0', '23c47234-5d4e-49ac-a500-921e7778d492', '200fb850-162e-49fa-bba2-9b967f722142'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:59:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b4b9a76d-3013-4a04-83ae-aeb5e421680f tempest-ServersNegativeTestJSON-1565159876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b4b9a76d-3013-4a04-83ae-aeb5e421680f tempest-ServersNegativeTestJSON-1565159876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b4b9a76d-3013-4a04-83ae-aeb5e421680f tempest-ServersNegativeTestJSON-1565159876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b4b9a76d-3013-4a04-83ae-aeb5e421680f tempest-ServersNegativeTestJSON-1565159876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b4b9a76d-3013-4a04-83ae-aeb5e421680f tempest-ServersNegativeTestJSON-1565159876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b4b9a76d-3013-4a04-83ae-aeb5e421680f tempest-ServersNegativeTestJSON-1565159876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:04 devstack sudo[96254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:59:04 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:05 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a65e3e56-7857-4c0b-a142-12b45ccd56fb tempest-VolumesTransfersV355Test-216513733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-376c4d02-bcbc-4dd7-bd5c-954c6c708d93" returned: 0 in 0.304s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a65e3e56-7857-4c0b-a142-12b45ccd56fb tempest-VolumesTransfersV355Test-216513733 None] Lock "cinder-quobyte-376c4d02-bcbc-4dd7-bd5c-954c6c708d93" released by "delete_volume" :: held 0.868s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:05 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-a65e3e56-7857-4c0b-a142-12b45ccd56fb tempest-VolumesTransfersV355Test-216513733 None] Created reservations ['bd3b93b8-195a-4cdc-80c4-8a5bba232518', '950f8583-ec04-466d-8f21-51524044e249', '07761ff9-bd53-4ae7-a1b4-8666f8131043', '978c8354-6fdf-4cfb-896a-6720ad6f1b8c'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:59:05 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b4b9a76d-3013-4a04-83ae-aeb5e421680f tempest-ServersNegativeTestJSON-1565159876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.307s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:05 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-b4b9a76d-3013-4a04-83ae-aeb5e421680f tempest-ServersNegativeTestJSON-1565159876 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:59:05 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-b4b9a76d-3013-4a04-83ae-aeb5e421680f tempest-ServersNegativeTestJSON-1565159876 None] Deleted volume successfully. Sep 21 11:59:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a65e3e56-7857-4c0b-a142-12b45ccd56fb tempest-VolumesTransfersV355Test-216513733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a65e3e56-7857-4c0b-a142-12b45ccd56fb tempest-VolumesTransfersV355Test-216513733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:05 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a65e3e56-7857-4c0b-a142-12b45ccd56fb tempest-VolumesTransfersV355Test-216513733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:05 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a65e3e56-7857-4c0b-a142-12b45ccd56fb tempest-VolumesTransfersV355Test-216513733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a65e3e56-7857-4c0b-a142-12b45ccd56fb tempest-VolumesTransfersV355Test-216513733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a65e3e56-7857-4c0b-a142-12b45ccd56fb tempest-VolumesTransfersV355Test-216513733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:05 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:59:05 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b4b9a76d-3013-4a04-83ae-aeb5e421680f tempest-ServersNegativeTestJSON-1565159876 None] Lock "cinder-20447cbf-801a-4be1-a7d5-fea9bca4d621-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:05 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a65e3e56-7857-4c0b-a142-12b45ccd56fb tempest-VolumesTransfersV355Test-216513733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.313s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:05 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-a65e3e56-7857-4c0b-a142-12b45ccd56fb tempest-VolumesTransfersV355Test-216513733 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:59:05 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-a65e3e56-7857-4c0b-a142-12b45ccd56fb tempest-VolumesTransfersV355Test-216513733 None] Deleted volume successfully. Sep 21 11:59:05 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-73f6460f-f11c-42eb-90a1-0afe47853bda tempest-GroupsTest-1078100098 None] Group tempest-Group2-418466478: creating Sep 21 11:59:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a65e3e56-7857-4c0b-a142-12b45ccd56fb tempest-VolumesTransfersV355Test-216513733 None] Lock "cinder-376c4d02-bcbc-4dd7-bd5c-954c6c708d93-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:05 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-73f6460f-f11c-42eb-90a1-0afe47853bda tempest-GroupsTest-1078100098 None] Group tempest-Group2-418466478: created successfully Sep 21 11:59:05 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-73f6460f-f11c-42eb-90a1-0afe47853bda tempest-GroupsTest-1078100098 None] Create group completed successfully. Sep 21 11:59:07 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:59:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Flow 'volume_create_manager' (2b195a76-af76-4401-b85b-5fe9e22cc22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:59:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aba2884-d342-46cf-b14a-4d03a92f3627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aba2884-d342-46cf-b14a-4d03a92f3627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-567309643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=644b8b66-e69e-4b55-83ef-58c44478ba60,host='devstack@QuobyteHD#QuobyteHD',id=a5d66297-a5ce-43bc-b47d-f7f5ee7d278c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5cd8debb3b4de29fbe545da56eec31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:59:08Z,use_quota=True,user_id='e4b1d8f3aeef445184f4515850f627cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab141034-6e97-4530-9c20-a3a5cda5dad3),volume_type_id=ab141034-6e97-4530-9c20-a3a5cda5dad3)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1add2114-2380-4b50-b1df-0011498bbfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1add2114-2380-4b50-b1df-0011498bbfda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e49cf12c-5cc7-4670-ab47-e0be2eaddb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e49cf12c-5cc7-4670-ab47-e0be2eaddb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5d66297-a5ce-43bc-b47d-f7f5ee7d278c', 'volume_name': 'volume-a5d66297-a5ce-43bc-b47d-f7f5ee7d278c', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d7e7d84-3977-48c2-ad36-b820a1e661b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d7e7d84-3977-48c2-ad36-b820a1e661b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef53f50-7e7b-45d5-a6ea-9ac06ec757a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:07 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Volume a5d66297-a5ce-43bc-b47d-f7f5ee7d278c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5d66297-a5ce-43bc-b47d-f7f5ee7d278c', 'volume_size': 1} Sep 21 11:59:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=644b8b66-e69e-4b55-83ef-58c44478ba60,created_at=2026-09-21T09:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-567309643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=644b8b66-e69e-4b55-83ef-58c44478ba60,host='devstack@QuobyteHD#QuobyteHD',id=a5d66297-a5ce-43bc-b47d-f7f5ee7d278c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5cd8debb3b4de29fbe545da56eec31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:59:08Z,use_quota=True,user_id='e4b1d8f3aeef445184f4515850f627cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab141034-6e97-4530-9c20-a3a5cda5dad3),volume_type_id=ab141034-6e97-4530-9c20-a3a5cda5dad3)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:59:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Creating volume a5d66297-a5ce-43bc-b47d-f7f5ee7d278c {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:59:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:59:07 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:59:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a5d66297-a5ce-43bc-b47d-f7f5ee7d278c 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:07 devstack sudo[96284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a5d66297-a5ce-43bc-b47d-f7f5ee7d278c 1073741824 Sep 21 11:59:07 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:08 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a5d66297-a5ce-43bc-b47d-f7f5ee7d278c 1073741824" returned: 0 in 0.601s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a5d66297-a5ce-43bc-b47d-f7f5ee7d278c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:08 devstack sudo[96293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a5d66297-a5ce-43bc-b47d-f7f5ee7d278c Sep 21 11:59:08 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:08 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a5d66297-a5ce-43bc-b47d-f7f5ee7d278c" returned: 0 in 0.378s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:08 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:59:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef53f50-7e7b-45d5-a6ea-9ac06ec757a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5d66297-a5ce-43bc-b47d-f7f5ee7d278c', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3112ca60-208a-4f3d-a88e-9ef7f587491a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:08 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Volume volume-a5d66297-a5ce-43bc-b47d-f7f5ee7d278c (a5d66297-a5ce-43bc-b47d-f7f5ee7d278c): created successfully Sep 21 11:59:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3112ca60-208a-4f3d-a88e-9ef7f587491a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Flow 'volume_create_manager' (2b195a76-af76-4401-b85b-5fe9e22cc22d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:59:08 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-897ef6a3-5d66-4906-9248-6e565e3f0b3a tempest-GroupsTest-1078100098 None] Created volume successfully. Sep 21 11:59:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-42a35f1b-be9c-43b7-a5ac-f5d2529f1ea6 tempest-GroupsTest-1078100098 None] Acquiring lock "cinder-quobyte-a5d66297-a5ce-43bc-b47d-f7f5ee7d278c" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-42a35f1b-be9c-43b7-a5ac-f5d2529f1ea6 tempest-GroupsTest-1078100098 None] Lock "cinder-quobyte-a5d66297-a5ce-43bc-b47d-f7f5ee7d278c" acquired by "delete_volume" :: waited 0.039s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:11 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48aed86-659f-4001-856d-3c73712962b8]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-42a35f1b-be9c-43b7-a5ac-f5d2529f1ea6 tempest-GroupsTest-1078100098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a5d66297-a5ce-43bc-b47d-f7f5ee7d278c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:11 devstack sudo[96298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a5d66297-a5ce-43bc-b47d-f7f5ee7d278c Sep 21 11:59:11 devstack sudo[96298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:11 devstack sudo[96298]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-42a35f1b-be9c-43b7-a5ac-f5d2529f1ea6 tempest-GroupsTest-1078100098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a5d66297-a5ce-43bc-b47d-f7f5ee7d278c" returned: 0 in 0.498s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-42a35f1b-be9c-43b7-a5ac-f5d2529f1ea6 tempest-GroupsTest-1078100098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a5d66297-a5ce-43bc-b47d-f7f5ee7d278c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:11 devstack sudo[96303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a5d66297-a5ce-43bc-b47d-f7f5ee7d278c Sep 21 11:59:11 devstack sudo[96303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:12 devstack sudo[96303]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-42a35f1b-be9c-43b7-a5ac-f5d2529f1ea6 tempest-GroupsTest-1078100098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a5d66297-a5ce-43bc-b47d-f7f5ee7d278c" returned: 0 in 0.339s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-42a35f1b-be9c-43b7-a5ac-f5d2529f1ea6 tempest-GroupsTest-1078100098 None] Lock "cinder-quobyte-a5d66297-a5ce-43bc-b47d-f7f5ee7d278c" released by "delete_volume" :: held 0.923s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:12 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-42a35f1b-be9c-43b7-a5ac-f5d2529f1ea6 tempest-GroupsTest-1078100098 None] Created reservations ['05fdeb0b-8766-4b38-be38-d391c76697d6'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:59:12 devstack cinder-volume[86366]: WARNING cinder.quota [None req-42a35f1b-be9c-43b7-a5ac-f5d2529f1ea6 tempest-GroupsTest-1078100098 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1474223219 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1474223219, it is now deprecated. Please use the default quota class for default quota. Sep 21 11:59:12 devstack cinder-volume[86366]: WARNING cinder.quota [None req-42a35f1b-be9c-43b7-a5ac-f5d2529f1ea6 tempest-GroupsTest-1078100098 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1474223219 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1474223219, it is now deprecated. Please use the default quota class for default quota. Sep 21 11:59:12 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-42a35f1b-be9c-43b7-a5ac-f5d2529f1ea6 tempest-GroupsTest-1078100098 None] Created reservations ['1b8d9eb8-c273-4c38-a87e-b5a53a174c0a', '6f294a89-5ee4-4ebf-938d-0ca4b96a7a46', '4a1d3909-7651-403f-b660-8fde245e4ad3', 'd7bb80e7-b775-4e89-b09e-2c572a437902'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:59:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-42a35f1b-be9c-43b7-a5ac-f5d2529f1ea6 tempest-GroupsTest-1078100098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-42a35f1b-be9c-43b7-a5ac-f5d2529f1ea6 tempest-GroupsTest-1078100098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:12 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-42a35f1b-be9c-43b7-a5ac-f5d2529f1ea6 tempest-GroupsTest-1078100098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:12 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-42a35f1b-be9c-43b7-a5ac-f5d2529f1ea6 tempest-GroupsTest-1078100098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-42a35f1b-be9c-43b7-a5ac-f5d2529f1ea6 tempest-GroupsTest-1078100098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-42a35f1b-be9c-43b7-a5ac-f5d2529f1ea6 tempest-GroupsTest-1078100098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:12 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:59:12 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:12 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-42a35f1b-be9c-43b7-a5ac-f5d2529f1ea6 tempest-GroupsTest-1078100098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.324s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:12 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-42a35f1b-be9c-43b7-a5ac-f5d2529f1ea6 tempest-GroupsTest-1078100098 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:59:12 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-42a35f1b-be9c-43b7-a5ac-f5d2529f1ea6 tempest-GroupsTest-1078100098 None] Delete group completed successfully. Sep 21 11:59:13 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-210f9061-f7bb-4c1e-bb27-2dfc1a21cc04 tempest-GroupsTest-1078100098 None] Created reservations ['bc5e9ac4-5664-43a9-82c0-28b9a712c3ec'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:59:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-210f9061-f7bb-4c1e-bb27-2dfc1a21cc04 tempest-GroupsTest-1078100098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-210f9061-f7bb-4c1e-bb27-2dfc1a21cc04 tempest-GroupsTest-1078100098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:13 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-210f9061-f7bb-4c1e-bb27-2dfc1a21cc04 tempest-GroupsTest-1078100098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:13 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-210f9061-f7bb-4c1e-bb27-2dfc1a21cc04 tempest-GroupsTest-1078100098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-210f9061-f7bb-4c1e-bb27-2dfc1a21cc04 tempest-GroupsTest-1078100098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-210f9061-f7bb-4c1e-bb27-2dfc1a21cc04 tempest-GroupsTest-1078100098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:13 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:59:13 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:14 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-210f9061-f7bb-4c1e-bb27-2dfc1a21cc04 tempest-GroupsTest-1078100098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.323s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:14 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-210f9061-f7bb-4c1e-bb27-2dfc1a21cc04 tempest-GroupsTest-1078100098 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:59:14 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-210f9061-f7bb-4c1e-bb27-2dfc1a21cc04 tempest-GroupsTest-1078100098 None] Delete group completed successfully. Sep 21 11:59:14 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:59:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Flow 'volume_create_manager' (d9c3b7f8-53b8-42f1-8d13-d7dfee8559bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:59:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04558db-c8f5-4e34-bb5f-c432f4877393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:15 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04558db-c8f5-4e34-bb5f-c432f4877393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-796268104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=652f013c-aae5-4d87-8665-77dd79bea874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e00c26e39e1345cb8b846641125a2eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:59:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:59:15Z,use_quota=True,user_id='a07d9bf5f56c486387ed6895e677514a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:15 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc4539bf-4c10-4d74-bbfa-2b0c72967490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:15 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc4539bf-4c10-4d74-bbfa-2b0c72967490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:15 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42026ab3-bc31-4841-8afd-a4c9d41ca9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:15 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42026ab3-bc31-4841-8afd-a4c9d41ca9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '652f013c-aae5-4d87-8665-77dd79bea874', 'volume_name': 'volume-652f013c-aae5-4d87-8665-77dd79bea874', 'volume_size': 2}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:15 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acaeb19f-473c-48ea-9328-b020a69d1805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:15 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acaeb19f-473c-48ea-9328-b020a69d1805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:15 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f90ce65-2151-47a1-b246-ffade79597b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:15 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Volume 652f013c-aae5-4d87-8665-77dd79bea874: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-652f013c-aae5-4d87-8665-77dd79bea874', 'volume_size': 2} Sep 21 11:59:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:15 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-796268104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=652f013c-aae5-4d87-8665-77dd79bea874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e00c26e39e1345cb8b846641125a2eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:59:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:59:15Z,use_quota=True,user_id='a07d9bf5f56c486387ed6895e677514a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:59:15 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Creating volume 652f013c-aae5-4d87-8665-77dd79bea874 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:59:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:15 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:15 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:15 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:59:15 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:59:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-652f013c-aae5-4d87-8665-77dd79bea874 2147483648 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:15 devstack sudo[96313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-652f013c-aae5-4d87-8665-77dd79bea874 2147483648 Sep 21 11:59:15 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:15 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-01a7b176-6da4-40a6-8dac-c40a54daf498 tempest-GroupsTest-1078100098 None] Group tempest-GroupsTest-Group-1491634460: creating Sep 21 11:59:15 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-01a7b176-6da4-40a6-8dac-c40a54daf498 tempest-GroupsTest-1078100098 None] Group tempest-GroupsTest-Group-1491634460: created successfully Sep 21 11:59:15 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-01a7b176-6da4-40a6-8dac-c40a54daf498 tempest-GroupsTest-1078100098 None] Create group completed successfully. Sep 21 11:59:15 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-652f013c-aae5-4d87-8665-77dd79bea874 2147483648" returned: 0 in 0.776s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-652f013c-aae5-4d87-8665-77dd79bea874 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:15 devstack sudo[96320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-652f013c-aae5-4d87-8665-77dd79bea874 Sep 21 11:59:15 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Flow 'volume_create_manager' (d566b0ae-78b5-4eee-8a4b-d0fcd9afb682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1119146a-4465-4136-9a71-2e2ea948864c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1119146a-4465-4136-9a71-2e2ea948864c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-669672564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7200dff-e07d-49a8-93f0-22fab1694f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f309d0a221247109f677d3ddb852c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:59:16Z,use_quota=True,user_id='45d1b083570a46fe9d0405859806aa50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba3884b1-674a-4c50-bc24-6da76bfe645e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba3884b1-674a-4c50-bc24-6da76bfe645e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85224ae8-cae7-49e9-9f85-6528ea656ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85224ae8-cae7-49e9-9f85-6528ea656ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7200dff-e07d-49a8-93f0-22fab1694f0f', 'volume_name': 'volume-e7200dff-e07d-49a8-93f0-22fab1694f0f', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6e07d8-e425-43ca-824a-2f3f520bb9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6e07d8-e425-43ca-824a-2f3f520bb9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (024df3c5-033f-48ab-87ff-1aca2615b29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:16 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Volume e7200dff-e07d-49a8-93f0-22fab1694f0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7200dff-e07d-49a8-93f0-22fab1694f0f', 'volume_size': 1} Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:16 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-652f013c-aae5-4d87-8665-77dd79bea874" returned: 0 in 0.316s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.014s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-669672564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7200dff-e07d-49a8-93f0-22fab1694f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f309d0a221247109f677d3ddb852c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:59:16Z,use_quota=True,user_id='45d1b083570a46fe9d0405859806aa50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Creating volume e7200dff-e07d-49a8-93f0-22fab1694f0f {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:59:16 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f90ce65-2151-47a1-b246-ffade79597b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-652f013c-aae5-4d87-8665-77dd79bea874', 'volume_size': 2}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3539021-22d4-4da3-a7fa-4a9c6e03d748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:16 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f 1073741824 Sep 21 11:59:16 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:16 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Volume volume-652f013c-aae5-4d87-8665-77dd79bea874 (652f013c-aae5-4d87-8665-77dd79bea874): created successfully Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3539021-22d4-4da3-a7fa-4a9c6e03d748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Flow 'volume_create_manager' (d9c3b7f8-53b8-42f1-8d13-d7dfee8559bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:59:16 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-11b6ddee-13f8-4cea-946d-eb2d80bfec6d tempest-VolumesCloneNegativeTest-718100872 None] Created volume successfully. Sep 21 11:59:16 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f 1073741824" returned: 0 in 0.540s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:16 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f Sep 21 11:59:16 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:17 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f" returned: 0 in 0.345s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (024df3c5-033f-48ab-87ff-1aca2615b29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7200dff-e07d-49a8-93f0-22fab1694f0f', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0390fa23-409b-47b7-9dff-c9c7c4ca1ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:17 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Volume volume-e7200dff-e07d-49a8-93f0-22fab1694f0f (e7200dff-e07d-49a8-93f0-22fab1694f0f): created successfully Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0390fa23-409b-47b7-9dff-c9c7c4ca1ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Flow 'volume_create_manager' (d566b0ae-78b5-4eee-8a4b-d0fcd9afb682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-26f1b379-6e21-4c9e-98dd-c71ea76762ab tempest-VolumesCloneNegativeTest-718100872 None] Acquiring lock "cinder-652f013c-aae5-4d87-8665-77dd79bea874-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:17 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-c3289a1c-1db8-4256-bcae-f6b075155471 tempest-VolumesCloneTest-1563314939 None] Created volume successfully. Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-26f1b379-6e21-4c9e-98dd-c71ea76762ab tempest-VolumesCloneNegativeTest-718100872 None] Lock "cinder-652f013c-aae5-4d87-8665-77dd79bea874-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-26f1b379-6e21-4c9e-98dd-c71ea76762ab tempest-VolumesCloneNegativeTest-718100872 None] Acquiring lock "cinder-quobyte-652f013c-aae5-4d87-8665-77dd79bea874" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-26f1b379-6e21-4c9e-98dd-c71ea76762ab tempest-VolumesCloneNegativeTest-718100872 None] Lock "cinder-quobyte-652f013c-aae5-4d87-8665-77dd79bea874" acquired by "delete_volume" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddde1f5-aba0-4223-ae3b-5ad90d3ac59c]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-26f1b379-6e21-4c9e-98dd-c71ea76762ab tempest-VolumesCloneNegativeTest-718100872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-652f013c-aae5-4d87-8665-77dd79bea874 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Flow 'volume_create_manager' (5037c6c1-dd30-4fef-b605-23368fd42729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7639d29b-3be5-4de6-8862-264e85f7a03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7639d29b-3be5-4de6-8862-264e85f7a03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1033321567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b8600a1-03f8-4336-998b-841ae249f01f,host='devstack@QuobyteHD#QuobyteHD',id=e32a53e6-26cf-4abf-a2e1-e3ce2cff5647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5cd8debb3b4de29fbe545da56eec31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:59:17Z,use_quota=True,user_id='e4b1d8f3aeef445184f4515850f627cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(291a9945-67ca-4da1-8d81-4eccd7068f3e),volume_type_id=291a9945-67ca-4da1-8d81-4eccd7068f3e)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b8aadb-f673-4a13-943e-fa4d809427a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:17 devstack sudo[96332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-652f013c-aae5-4d87-8665-77dd79bea874 Sep 21 11:59:17 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b8aadb-f673-4a13-943e-fa4d809427a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5781f63a-1121-4893-a544-c08e3d02676b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5781f63a-1121-4893-a544-c08e3d02676b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e32a53e6-26cf-4abf-a2e1-e3ce2cff5647', 'volume_name': 'volume-e32a53e6-26cf-4abf-a2e1-e3ce2cff5647', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e567ce-31ce-4023-8e35-9cfb4f79e271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e567ce-31ce-4023-8e35-9cfb4f79e271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72d1852-17c2-406b-a3d9-8437f978eda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:17 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Volume e32a53e6-26cf-4abf-a2e1-e3ce2cff5647: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e32a53e6-26cf-4abf-a2e1-e3ce2cff5647', 'volume_size': 1} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7b8600a1-03f8-4336-998b-841ae249f01f,created_at=2026-09-21T09:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1033321567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b8600a1-03f8-4336-998b-841ae249f01f,host='devstack@QuobyteHD#QuobyteHD',id=e32a53e6-26cf-4abf-a2e1-e3ce2cff5647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5cd8debb3b4de29fbe545da56eec31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:59:17Z,use_quota=True,user_id='e4b1d8f3aeef445184f4515850f627cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(291a9945-67ca-4da1-8d81-4eccd7068f3e),volume_type_id=291a9945-67ca-4da1-8d81-4eccd7068f3e)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Creating volume e32a53e6-26cf-4abf-a2e1-e3ce2cff5647 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:59:17 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e32a53e6-26cf-4abf-a2e1-e3ce2cff5647 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:17 devstack sudo[96334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e32a53e6-26cf-4abf-a2e1-e3ce2cff5647 1073741824 Sep 21 11:59:17 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:17 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-26f1b379-6e21-4c9e-98dd-c71ea76762ab tempest-VolumesCloneNegativeTest-718100872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-652f013c-aae5-4d87-8665-77dd79bea874" returned: 0 in 0.436s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-26f1b379-6e21-4c9e-98dd-c71ea76762ab tempest-VolumesCloneNegativeTest-718100872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-652f013c-aae5-4d87-8665-77dd79bea874 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:17 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-652f013c-aae5-4d87-8665-77dd79bea874 Sep 21 11:59:17 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:18 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e32a53e6-26cf-4abf-a2e1-e3ce2cff5647 1073741824" returned: 0 in 0.553s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:18 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-26f1b379-6e21-4c9e-98dd-c71ea76762ab tempest-VolumesCloneNegativeTest-718100872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-652f013c-aae5-4d87-8665-77dd79bea874" returned: 0 in 0.312s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:18 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-26f1b379-6e21-4c9e-98dd-c71ea76762ab tempest-VolumesCloneNegativeTest-718100872 None] Lock "cinder-quobyte-652f013c-aae5-4d87-8665-77dd79bea874" released by "delete_volume" :: held 0.824s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e32a53e6-26cf-4abf-a2e1-e3ce2cff5647 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:18 devstack sudo[96346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e32a53e6-26cf-4abf-a2e1-e3ce2cff5647 Sep 21 11:59:18 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:18 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-26f1b379-6e21-4c9e-98dd-c71ea76762ab tempest-VolumesCloneNegativeTest-718100872 None] Created reservations ['1b536e6c-3c0a-4119-b966-ec4581e67f3c', '48100994-8fc8-441a-84aa-421fc19b00fe', '91c3fdd7-21f4-4c08-842a-bb045908419d', 'c609914f-2a22-4bf5-9b50-4e1154e1bcf7'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:59:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-26f1b379-6e21-4c9e-98dd-c71ea76762ab tempest-VolumesCloneNegativeTest-718100872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-26f1b379-6e21-4c9e-98dd-c71ea76762ab tempest-VolumesCloneNegativeTest-718100872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:18 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-26f1b379-6e21-4c9e-98dd-c71ea76762ab tempest-VolumesCloneNegativeTest-718100872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:18 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-26f1b379-6e21-4c9e-98dd-c71ea76762ab tempest-VolumesCloneNegativeTest-718100872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-26f1b379-6e21-4c9e-98dd-c71ea76762ab tempest-VolumesCloneNegativeTest-718100872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-26f1b379-6e21-4c9e-98dd-c71ea76762ab tempest-VolumesCloneNegativeTest-718100872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:18 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:59:18 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:18 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e32a53e6-26cf-4abf-a2e1-e3ce2cff5647" returned: 0 in 0.396s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:18 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:59:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72d1852-17c2-406b-a3d9-8437f978eda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e32a53e6-26cf-4abf-a2e1-e3ce2cff5647', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44176839-7f0d-461a-b3ba-402764f91bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:18 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Volume volume-e32a53e6-26cf-4abf-a2e1-e3ce2cff5647 (e32a53e6-26cf-4abf-a2e1-e3ce2cff5647): created successfully Sep 21 11:59:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44176839-7f0d-461a-b3ba-402764f91bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Flow 'volume_create_manager' (5037c6c1-dd30-4fef-b605-23368fd42729) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:59:18 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-c9cea251-0c8c-4765-93da-147268c98781 tempest-GroupsTest-1078100098 None] Created volume successfully. Sep 21 11:59:18 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-26f1b379-6e21-4c9e-98dd-c71ea76762ab tempest-VolumesCloneNegativeTest-718100872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.415s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:18 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-26f1b379-6e21-4c9e-98dd-c71ea76762ab tempest-VolumesCloneNegativeTest-718100872 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:59:18 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-26f1b379-6e21-4c9e-98dd-c71ea76762ab tempest-VolumesCloneNegativeTest-718100872 None] Deleted volume successfully. Sep 21 11:59:18 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-26f1b379-6e21-4c9e-98dd-c71ea76762ab tempest-VolumesCloneNegativeTest-718100872 None] Lock "cinder-652f013c-aae5-4d87-8665-77dd79bea874-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:19 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:59:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Flow 'volume_create_manager' (b3151db4-a976-46f7-81aa-f6bb26c2290f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:59:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c143a3-18b4-4080-9127-e8f052350204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52c143a3-18b4-4080-9127-e8f052350204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1708131422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50a3b31f-a177-481f-984f-4593f96e6615,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f309d0a221247109f677d3ddb852c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:59:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=e7200dff-e07d-49a8-93f0-22fab1694f0f,status='creating',terminated_at=None,updated_at=2026-09-21T09:59:19Z,use_quota=True,user_id='45d1b083570a46fe9d0405859806aa50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42bfdc02-a3f4-489b-a195-8761dc0cd566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42bfdc02-a3f4-489b-a195-8761dc0cd566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (098d4074-4db1-491f-b1cb-271a995be982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (098d4074-4db1-491f-b1cb-271a995be982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '50a3b31f-a177-481f-984f-4593f96e6615', 'volume_name': 'volume-50a3b31f-a177-481f-984f-4593f96e6615', 'volume_size': 2, 'source_volid': 'e7200dff-e07d-49a8-93f0-22fab1694f0f', 'source_volstatus': 'available'}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db1d776-b54a-488c-bfce-c594dc4fc9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2db1d776-b54a-488c-bfce-c594dc4fc9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f226248c-879f-462f-b72e-faf55bc462af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:19 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Volume 50a3b31f-a177-481f-984f-4593f96e6615: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-50a3b31f-a177-481f-984f-4593f96e6615', 'volume_size': 2, 'source_volid': 'e7200dff-e07d-49a8-93f0-22fab1694f0f', 'source_volstatus': 'available'} Sep 21 11:59:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:19 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Cloning volume e7200dff-e07d-49a8-93f0-22fab1694f0f to volume 50a3b31f-a177-481f-984f-4593f96e6615 Sep 21 11:59:19 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Creating offline snapshot 6bb0a2ce-8700-4b2a-9ea3-25beca7282af of volume e7200dff-e07d-49a8-93f0-22fab1694f0f {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 11:59:19 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf1042b-9365-4d3d-b257-f34d627a94d5]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:19 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f Sep 21 11:59:19 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:19 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f" returned: 0 in 0.414s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.6bb0a2ce-8700-4b2a-9ea3-25beca7282af 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:19 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.6bb0a2ce-8700-4b2a-9ea3-25beca7282af 1G Sep 21 11:59:19 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:20 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.6bb0a2ce-8700-4b2a-9ea3-25beca7282af 1G" returned: 0 in 0.693s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7200dff-e07d-49a8-93f0-22fab1694f0f -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.6bb0a2ce-8700-4b2a-9ea3-25beca7282af {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:20 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7200dff-e07d-49a8-93f0-22fab1694f0f -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.6bb0a2ce-8700-4b2a-9ea3-25beca7282af Sep 21 11:59:20 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:20 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:59:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Flow 'volume_create_manager' (4b10f22d-22cb-4419-90dd-5fdecc08d688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:59:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f691782c-922f-4db2-a962-3ae9d820b713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f691782c-922f-4db2-a962-3ae9d820b713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1103329409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01e3b3bd1bc54d1192edb592e0cd9b48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:59:21Z,use_quota=True,user_id='5ce9a97f5ff64d15838bab566e9747ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (503baf49-d058-4a91-b623-02b2575ab80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (503baf49-d058-4a91-b623-02b2575ab80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20de2b3-2076-4329-9645-dd373248caae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f20de2b3-2076-4329-9645-dd373248caae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c', 'volume_name': 'volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b693ddc3-9b61-4092-be03-d0526daab0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b693ddc3-9b61-4092-be03-d0526daab0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312de041-b5ed-4f32-9931-2ba2320a2fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:20 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Volume 2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c', 'volume_size': 1} Sep 21 11:59:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:20 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7200dff-e07d-49a8-93f0-22fab1694f0f -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.6bb0a2ce-8700-4b2a-9ea3-25beca7282af" returned: 0 in 0.539s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:21 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.6bb0a2ce-8700-4b2a-9ea3-25beca7282af is being set with open permissions: ugo+rw Sep 21 11:59:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.6bb0a2ce-8700-4b2a-9ea3-25beca7282af {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:21 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.6bb0a2ce-8700-4b2a-9ea3-25beca7282af Sep 21 11:59:21 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:21 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:59:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Flow 'volume_create_manager' (e69622ac-7b06-4dd1-8e51-43e6cd2683ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:59:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7ceea86-7388-4384-b85b-a77105ccce50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7ceea86-7388-4384-b85b-a77105ccce50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1345642350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b8600a1-03f8-4336-998b-841ae249f01f,host='devstack@QuobyteHD#QuobyteHD',id=f7570db0-d6e9-40d5-819a-bbfca36f0561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5cd8debb3b4de29fbe545da56eec31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:59:21Z,use_quota=True,user_id='e4b1d8f3aeef445184f4515850f627cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(291a9945-67ca-4da1-8d81-4eccd7068f3e),volume_type_id=291a9945-67ca-4da1-8d81-4eccd7068f3e)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48006e2e-f3b7-4145-b261-4a57317b3782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48006e2e-f3b7-4145-b261-4a57317b3782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc42017-24fb-4305-9217-c8e0d4d81e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc42017-24fb-4305-9217-c8e0d4d81e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7570db0-d6e9-40d5-819a-bbfca36f0561', 'volume_name': 'volume-f7570db0-d6e9-40d5-819a-bbfca36f0561', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b213378-f524-490c-87f4-2e2609352139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b213378-f524-490c-87f4-2e2609352139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c305523-3218-48ff-aab5-833529a93d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:21 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Volume f7570db0-d6e9-40d5-819a-bbfca36f0561: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7570db0-d6e9-40d5-819a-bbfca36f0561', 'volume_size': 1} Sep 21 11:59:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:21 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.6bb0a2ce-8700-4b2a-9ea3-25beca7282af" returned: 0 in 0.273s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:21 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.info Sep 21 11:59:21 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:21 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.info" returned: 0 in 0.289s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:21 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.info is being set with open permissions: ugo+rw Sep 21 11:59:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:21 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.info Sep 21 11:59:21 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:21 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.info" returned: 0 in 0.269s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Acquiring lock "cinder-quobyte-50a3b31f-a177-481f-984f-4593f96e6615" by "_copy_volume_from_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Lock "cinder-quobyte-50a3b31f-a177-481f-984f-4593f96e6615" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:21 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] snapshot: 6bb0a2ce-8700-4b2a-9ea3-25beca7282af, volume: 50a3b31f-a177-481f-984f-4593f96e6615, {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 21 11:59:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:21 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:21 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:21 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14c67cc-a684-4f26-8b8e-fb40cd294023]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.6bb0a2ce-8700-4b2a-9ea3-25beca7282af {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:22 devstack sudo[96379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.6bb0a2ce-8700-4b2a-9ea3-25beca7282af Sep 21 11:59:22 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:22 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.6bb0a2ce-8700-4b2a-9ea3-25beca7282af" returned: 0 in 0.429s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7200dff-e07d-49a8-93f0-22fab1694f0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 11:59:22 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[414f5710-f303-4293-8525-e0df1c051818]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:22 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f Sep 21 11:59:22 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:22 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f" returned: 0 in 0.393s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 21 11:59:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Creating direct copy from snapshot {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 21 11:59:22 devstack cinder-volume[86366]: DEBUG cinder.utils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Path /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-50a3b31f-a177-481f-984f-4593f96e6615 not found in is_blk_device check {{(pid=86366) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 21 11:59:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-50a3b31f-a177-481f-984f-4593f96e6615 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:22 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-50a3b31f-a177-481f-984f-4593f96e6615 Sep 21 11:59:22 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:23 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:59:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Flow 'volume_create_manager' (1ef0cb48-9b7e-4816-93ae-de3515314a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:59:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d8061a-5229-4d81-848b-69e38d8b7c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d8061a-5229-4d81-848b-69e38d8b7c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-662658656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6943fa32-7abb-44a1-88a2-78f0803b0240,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b21e9844845c423b979638bf4dd80987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:59:23Z,use_quota=True,user_id='31e9c4a43ad7480f8aa37b41ab5b66f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c9c527e-166b-4d22-bbeb-c0debf9ff6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c9c527e-166b-4d22-bbeb-c0debf9ff6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80f077e-7ee9-404f-a896-cd020ab44dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80f077e-7ee9-404f-a896-cd020ab44dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6943fa32-7abb-44a1-88a2-78f0803b0240', 'volume_name': 'volume-6943fa32-7abb-44a1-88a2-78f0803b0240', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c64d71e-74e9-441d-b321-572ee51a6fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c64d71e-74e9-441d-b321-572ee51a6fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b12ccde-e770-4700-88c8-715648badecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:23 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Volume 6943fa32-7abb-44a1-88a2-78f0803b0240: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6943fa32-7abb-44a1-88a2-78f0803b0240', 'volume_size': 1} Sep 21 11:59:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:29 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-50a3b31f-a177-481f-984f-4593f96e6615" returned: 0 in 6.373s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:29 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Image conversion details: src /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f, size 1024.00 MB, duration 6.37 sec, destination /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-50a3b31f-a177-481f-984f-4593f96e6615 {{(pid=86366) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 11:59:29 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Converted 1024.00 MB image at 160.66 MB/s Sep 21 11:59:29 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-50a3b31f-a177-481f-984f-4593f96e6615 is being set with open permissions: ugo+rw Sep 21 11:59:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-50a3b31f-a177-481f-984f-4593f96e6615 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:29 devstack sudo[96406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-50a3b31f-a177-481f-984f-4593f96e6615 Sep 21 11:59:29 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:29 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-50a3b31f-a177-481f-984f-4593f96e6615" returned: 0 in 0.245s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:29 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Lock "cinder-quobyte-50a3b31f-a177-481f-984f-4593f96e6615" released by "_copy_volume_from_snapshot" :: held 7.522s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:29 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Acquiring lock "cinder-quobyte-6bb0a2ce-8700-4b2a-9ea3-25beca7282af" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:29 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Lock "cinder-quobyte-6bb0a2ce-8700-4b2a-9ea3-25beca7282af" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Deleting offline snapshot 6bb0a2ce-8700-4b2a-9ea3-25beca7282af of volume e7200dff-e07d-49a8-93f0-22fab1694f0f {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 11:59:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] snapshot_file for this snap is: volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.6bb0a2ce-8700-4b2a-9ea3-25beca7282af {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 11:59:29 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[b124561c-be31-4c98-bc3e-3f8546288e33]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.6bb0a2ce-8700-4b2a-9ea3-25beca7282af {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:29 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.6bb0a2ce-8700-4b2a-9ea3-25beca7282af Sep 21 11:59:29 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:29 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.6bb0a2ce-8700-4b2a-9ea3-25beca7282af" returned: 0 in 0.365s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7200dff-e07d-49a8-93f0-22fab1694f0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 11:59:29 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7c21c1-13ec-4bf9-9a4b-5c1ae2e1d3d5]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:29 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f Sep 21 11:59:29 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:30 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f" returned: 0 in 0.545s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.6bb0a2ce-8700-4b2a-9ea3-25beca7282af {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:30 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.6bb0a2ce-8700-4b2a-9ea3-25beca7282af Sep 21 11:59:30 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:30 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.6bb0a2ce-8700-4b2a-9ea3-25beca7282af" returned: 0 in 0.342s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.6bb0a2ce-8700-4b2a-9ea3-25beca7282af {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:30 devstack sudo[96425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.6bb0a2ce-8700-4b2a-9ea3-25beca7282af Sep 21 11:59:30 devstack sudo[96425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:31 devstack sudo[96425]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f.6bb0a2ce-8700-4b2a-9ea3-25beca7282af" returned: 0 in 0.245s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Lock "cinder-quobyte-6bb0a2ce-8700-4b2a-9ea3-25beca7282af" released by "_delete_snapshot" :: held 1.594s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.796s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.242s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1103329409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01e3b3bd1bc54d1192edb592e0cd9b48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:59:21Z,use_quota=True,user_id='5ce9a97f5ff64d15838bab566e9747ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Creating volume 2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:59:31 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:31 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c 1073741824 Sep 21 11:59:31 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f226248c-879f-462f-b72e-faf55bc462af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50a3b31f-a177-481f-984f-4593f96e6615', 'volume_size': 2, 'source_volid': 'e7200dff-e07d-49a8-93f0-22fab1694f0f', 'source_volstatus': 'available'}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b959e40a-6a91-49c3-a228-3929dbcc845b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:31 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Volume volume-50a3b31f-a177-481f-984f-4593f96e6615 (50a3b31f-a177-481f-984f-4593f96e6615): created successfully Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b959e40a-6a91-49c3-a228-3929dbcc845b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Flow 'volume_create_manager' (b3151db4-a976-46f7-81aa-f6bb26c2290f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:59:31 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-fda75b2a-8435-498b-b49f-4dc0c6cac6ea tempest-VolumesCloneTest-1563314939 None] Created volume successfully. Sep 21 11:59:31 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c 1073741824" returned: 0 in 0.422s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:31 devstack sudo[96434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c Sep 21 11:59:31 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:31 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c" returned: 0 in 0.279s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.774s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7b8600a1-03f8-4336-998b-841ae249f01f,created_at=2026-09-21T09:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1345642350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b8600a1-03f8-4336-998b-841ae249f01f,host='devstack@QuobyteHD#QuobyteHD',id=f7570db0-d6e9-40d5-819a-bbfca36f0561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b5cd8debb3b4de29fbe545da56eec31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:59:21Z,use_quota=True,user_id='e4b1d8f3aeef445184f4515850f627cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(291a9945-67ca-4da1-8d81-4eccd7068f3e),volume_type_id=291a9945-67ca-4da1-8d81-4eccd7068f3e)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Creating volume f7570db0-d6e9-40d5-819a-bbfca36f0561 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:59:31 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f7570db0-d6e9-40d5-819a-bbfca36f0561 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312de041-b5ed-4f32-9931-2ba2320a2fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9282580-eea6-462a-81e2-4037f187da7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:31 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f7570db0-d6e9-40d5-819a-bbfca36f0561 1073741824 Sep 21 11:59:31 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:31 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Volume volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c (2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c): created successfully Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9282580-eea6-462a-81e2-4037f187da7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Flow 'volume_create_manager' (4b10f22d-22cb-4419-90dd-5fdecc08d688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:59:32 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-d78a7698-0e93-4654-ac6f-933c25aedbbc req-325c91b0-f134-49c9-89b9-55ab71ceef49 tempest-VolumesSnapshotsTestJSON-862480745 None] Created volume successfully. Sep 21 11:59:32 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f7570db0-d6e9-40d5-819a-bbfca36f0561 1073741824" returned: 0 in 0.464s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f7570db0-d6e9-40d5-819a-bbfca36f0561 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:32 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f7570db0-d6e9-40d5-819a-bbfca36f0561 Sep 21 11:59:32 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:32 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-ca7e8cd4-41dc-4ca6-a958-02b712d15a34 tempest-VolumesCloneTest-1563314939 None] Acquiring lock "cinder-50a3b31f-a177-481f-984f-4593f96e6615-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:32 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-ca7e8cd4-41dc-4ca6-a958-02b712d15a34 tempest-VolumesCloneTest-1563314939 None] Lock "cinder-50a3b31f-a177-481f-984f-4593f96e6615-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:32 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-ca7e8cd4-41dc-4ca6-a958-02b712d15a34 tempest-VolumesCloneTest-1563314939 None] Acquiring lock "cinder-quobyte-50a3b31f-a177-481f-984f-4593f96e6615" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:32 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-ca7e8cd4-41dc-4ca6-a958-02b712d15a34 tempest-VolumesCloneTest-1563314939 None] Lock "cinder-quobyte-50a3b31f-a177-481f-984f-4593f96e6615" acquired by "delete_volume" :: waited 0.017s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:32 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8bbe34-c2a3-41aa-b030-f1ca98e2ed1b]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ca7e8cd4-41dc-4ca6-a958-02b712d15a34 tempest-VolumesCloneTest-1563314939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-50a3b31f-a177-481f-984f-4593f96e6615 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:32 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f7570db0-d6e9-40d5-819a-bbfca36f0561" returned: 0 in 0.256s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:59:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.108s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:59:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-662658656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6943fa32-7abb-44a1-88a2-78f0803b0240,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b21e9844845c423b979638bf4dd80987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:59:23Z,use_quota=True,user_id='31e9c4a43ad7480f8aa37b41ab5b66f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:59:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Creating volume 6943fa32-7abb-44a1-88a2-78f0803b0240 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:59:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:59:32 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:59:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6943fa32-7abb-44a1-88a2-78f0803b0240 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:32 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c305523-3218-48ff-aab5-833529a93d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7570db0-d6e9-40d5-819a-bbfca36f0561', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:32 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6943fa32-7abb-44a1-88a2-78f0803b0240 1073741824 Sep 21 11:59:32 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:32 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737188db-c91c-42d3-9b65-3bfad23cdc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:32 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Volume volume-f7570db0-d6e9-40d5-819a-bbfca36f0561 (f7570db0-d6e9-40d5-819a-bbfca36f0561): created successfully Sep 21 11:59:32 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737188db-c91c-42d3-9b65-3bfad23cdc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:32 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Flow 'volume_create_manager' (e69622ac-7b06-4dd1-8e51-43e6cd2683ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:59:32 devstack sudo[96446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-50a3b31f-a177-481f-984f-4593f96e6615 Sep 21 11:59:32 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:32 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-2056a416-35ca-4a4e-846d-07b87f448d3c tempest-GroupsTest-1078100098 None] Created volume successfully. Sep 21 11:59:33 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ca7e8cd4-41dc-4ca6-a958-02b712d15a34 tempest-VolumesCloneTest-1563314939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-50a3b31f-a177-481f-984f-4593f96e6615" returned: 0 in 0.444s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ca7e8cd4-41dc-4ca6-a958-02b712d15a34 tempest-VolumesCloneTest-1563314939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-50a3b31f-a177-481f-984f-4593f96e6615 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:33 devstack sudo[96458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-50a3b31f-a177-481f-984f-4593f96e6615 Sep 21 11:59:33 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-1bc31786-cedc-47a6-98bc-251aa5053f78 req-f49d269e-d755-42dd-8c3c-ff5d25dfd881 tempest-VolumesSnapshotsTestJSON-862480745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:33 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6943fa32-7abb-44a1-88a2-78f0803b0240 1073741824" returned: 0 in 0.651s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6943fa32-7abb-44a1-88a2-78f0803b0240 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:33 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6943fa32-7abb-44a1-88a2-78f0803b0240 Sep 21 11:59:33 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:33 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ca7e8cd4-41dc-4ca6-a958-02b712d15a34 tempest-VolumesCloneTest-1563314939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-50a3b31f-a177-481f-984f-4593f96e6615" returned: 0 in 0.342s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:33 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-bcf5dd2a-5eaf-41a8-9792-90d4e1486bca tempest-GroupsTest-1078100098 None] Update group completed successfully. Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-ca7e8cd4-41dc-4ca6-a958-02b712d15a34 tempest-VolumesCloneTest-1563314939 None] Lock "cinder-quobyte-50a3b31f-a177-481f-984f-4593f96e6615" released by "delete_volume" :: held 0.841s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-ca7e8cd4-41dc-4ca6-a958-02b712d15a34 tempest-VolumesCloneTest-1563314939 None] Created reservations ['991273df-37c1-48b8-bf6b-2ee73b917020', '2461dab0-dc4b-4402-aab5-388640d85ecf', '3b4d3714-fee8-49fd-8415-5684c1f2ebc1', 'c2811a5e-cab6-4758-8c6e-f23db4dbb06a'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-ca7e8cd4-41dc-4ca6-a958-02b712d15a34 tempest-VolumesCloneTest-1563314939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-ca7e8cd4-41dc-4ca6-a958-02b712d15a34 tempest-VolumesCloneTest-1563314939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-ca7e8cd4-41dc-4ca6-a958-02b712d15a34 tempest-VolumesCloneTest-1563314939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-ca7e8cd4-41dc-4ca6-a958-02b712d15a34 tempest-VolumesCloneTest-1563314939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-ca7e8cd4-41dc-4ca6-a958-02b712d15a34 tempest-VolumesCloneTest-1563314939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ca7e8cd4-41dc-4ca6-a958-02b712d15a34 tempest-VolumesCloneTest-1563314939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:33 devstack sudo[96464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:59:33 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:33 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6943fa32-7abb-44a1-88a2-78f0803b0240" returned: 0 in 0.276s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-1bc31786-cedc-47a6-98bc-251aa5053f78 req-f49d269e-d755-42dd-8c3c-ff5d25dfd881 tempest-VolumesSnapshotsTestJSON-862480745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.440s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [req-1bc31786-cedc-47a6-98bc-251aa5053f78 req-f49d269e-d755-42dd-8c3c-ff5d25dfd881 tempest-VolumesSnapshotsTestJSON-862480745 None] Creating offline snapshot 329572d6-7e9f-41e3-9126-6ca5048a9f2a of volume 2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b12ccde-e770-4700-88c8-715648badecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6943fa32-7abb-44a1-88a2-78f0803b0240', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a6333ce-0c65-408c-b301-3cbdcf46a78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0cc756-b1c2-44c8-b357-e468915a4257]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-1bc31786-cedc-47a6-98bc-251aa5053f78 req-f49d269e-d755-42dd-8c3c-ff5d25dfd881 tempest-VolumesSnapshotsTestJSON-862480745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:33 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Volume volume-6943fa32-7abb-44a1-88a2-78f0803b0240 (6943fa32-7abb-44a1-88a2-78f0803b0240): created successfully Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a6333ce-0c65-408c-b301-3cbdcf46a78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Flow 'volume_create_manager' (1ef0cb48-9b7e-4816-93ae-de3515314a26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:59:33 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-6fc3f1b7-2b2b-4f1b-8c20-9a49982e88a7 tempest-VolumesListTestJSON-128925852 None] Created volume successfully. Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e6376851-eae0-4baa-93cb-11caf5c41035 tempest-VolumesCloneTest-1563314939 None] Acquiring lock "cinder-e7200dff-e07d-49a8-93f0-22fab1694f0f-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e6376851-eae0-4baa-93cb-11caf5c41035 tempest-VolumesCloneTest-1563314939 None] Lock "cinder-e7200dff-e07d-49a8-93f0-22fab1694f0f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:33 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:33 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c Sep 21 11:59:33 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ca7e8cd4-41dc-4ca6-a958-02b712d15a34 tempest-VolumesCloneTest-1563314939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.295s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-ca7e8cd4-41dc-4ca6-a958-02b712d15a34 tempest-VolumesCloneTest-1563314939 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:59:33 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-ca7e8cd4-41dc-4ca6-a958-02b712d15a34 tempest-VolumesCloneTest-1563314939 None] Deleted volume successfully. Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e6376851-eae0-4baa-93cb-11caf5c41035 tempest-VolumesCloneTest-1563314939 None] Acquiring lock "cinder-quobyte-e7200dff-e07d-49a8-93f0-22fab1694f0f" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-ca7e8cd4-41dc-4ca6-a958-02b712d15a34 tempest-VolumesCloneTest-1563314939 None] Lock "cinder-50a3b31f-a177-481f-984f-4593f96e6615-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e6376851-eae0-4baa-93cb-11caf5c41035 tempest-VolumesCloneTest-1563314939 None] Lock "cinder-quobyte-e7200dff-e07d-49a8-93f0-22fab1694f0f" acquired by "delete_volume" :: waited 0.027s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:34 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[6118aba9-93b8-4003-aa15-43b8783261f1]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e6376851-eae0-4baa-93cb-11caf5c41035 tempest-VolumesCloneTest-1563314939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:34 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f Sep 21 11:59:34 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:34 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-1bc31786-cedc-47a6-98bc-251aa5053f78 req-f49d269e-d755-42dd-8c3c-ff5d25dfd881 tempest-VolumesSnapshotsTestJSON-862480745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c" returned: 0 in 0.444s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-1bc31786-cedc-47a6-98bc-251aa5053f78 req-f49d269e-d755-42dd-8c3c-ff5d25dfd881 tempest-VolumesSnapshotsTestJSON-862480745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c.329572d6-7e9f-41e3-9126-6ca5048a9f2a 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:34 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c.329572d6-7e9f-41e3-9126-6ca5048a9f2a 1G Sep 21 11:59:34 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:34 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e6376851-eae0-4baa-93cb-11caf5c41035 tempest-VolumesCloneTest-1563314939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f" returned: 0 in 0.452s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e6376851-eae0-4baa-93cb-11caf5c41035 tempest-VolumesCloneTest-1563314939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:34 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f Sep 21 11:59:34 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:34 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:59:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Flow 'volume_create_manager' (81b07878-1440-4279-b57a-df04a071b8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:59:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6718ef21-e3ab-4771-a65a-f03d1790a8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:34 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-1bc31786-cedc-47a6-98bc-251aa5053f78 req-f49d269e-d755-42dd-8c3c-ff5d25dfd881 tempest-VolumesSnapshotsTestJSON-862480745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c.329572d6-7e9f-41e3-9126-6ca5048a9f2a 1G" returned: 0 in 0.595s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-1bc31786-cedc-47a6-98bc-251aa5053f78 req-f49d269e-d755-42dd-8c3c-ff5d25dfd881 tempest-VolumesSnapshotsTestJSON-862480745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c.329572d6-7e9f-41e3-9126-6ca5048a9f2a {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:34 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e6376851-eae0-4baa-93cb-11caf5c41035 tempest-VolumesCloneTest-1563314939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7200dff-e07d-49a8-93f0-22fab1694f0f" returned: 0 in 0.351s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:34 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c.329572d6-7e9f-41e3-9126-6ca5048a9f2a Sep 21 11:59:34 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6718ef21-e3ab-4771-a65a-f03d1790a8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1800749407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc685545-a918-4910-9bc9-abd27ae9a818,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b21e9844845c423b979638bf4dd80987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:59:35Z,use_quota=True,user_id='31e9c4a43ad7480f8aa37b41ab5b66f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20eba30-3219-4b28-a4fe-20a80e52146e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20eba30-3219-4b28-a4fe-20a80e52146e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b003550e-4c90-4991-af08-b595a551bd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b003550e-4c90-4991-af08-b595a551bd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc685545-a918-4910-9bc9-abd27ae9a818', 'volume_name': 'volume-fc685545-a918-4910-9bc9-abd27ae9a818', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b35481-f961-4152-a303-e5672d6f0f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b35481-f961-4152-a303-e5672d6f0f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e1265eb-7de1-4fa9-a9b1-155f4102fb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:34 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Volume fc685545-a918-4910-9bc9-abd27ae9a818: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc685545-a918-4910-9bc9-abd27ae9a818', 'volume_size': 1} Sep 21 11:59:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:34 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e6376851-eae0-4baa-93cb-11caf5c41035 tempest-VolumesCloneTest-1563314939 None] Lock "cinder-quobyte-e7200dff-e07d-49a8-93f0-22fab1694f0f" released by "delete_volume" :: held 0.928s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:34 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-e6376851-eae0-4baa-93cb-11caf5c41035 tempest-VolumesCloneTest-1563314939 None] Created reservations ['0d41e261-392a-4f16-9a4e-f4b2868b965a', 'ae0f3988-6274-4244-bccc-b9d44cc92590', '3f28cf41-b36e-4774-b551-b42ac68864a1', '16381174-4adf-42fb-9b2d-7fced053eea4'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:59:34 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-09c2f98c-56cd-47dc-9134-879629423f49 tempest-GroupsTest-1078100098 None] Update group completed successfully. Sep 21 11:59:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e6376851-eae0-4baa-93cb-11caf5c41035 tempest-VolumesCloneTest-1563314939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e6376851-eae0-4baa-93cb-11caf5c41035 tempest-VolumesCloneTest-1563314939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e6376851-eae0-4baa-93cb-11caf5c41035 tempest-VolumesCloneTest-1563314939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e6376851-eae0-4baa-93cb-11caf5c41035 tempest-VolumesCloneTest-1563314939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e6376851-eae0-4baa-93cb-11caf5c41035 tempest-VolumesCloneTest-1563314939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e6376851-eae0-4baa-93cb-11caf5c41035 tempest-VolumesCloneTest-1563314939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:35 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:59:35 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:35 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-1bc31786-cedc-47a6-98bc-251aa5053f78 req-f49d269e-d755-42dd-8c3c-ff5d25dfd881 tempest-VolumesSnapshotsTestJSON-862480745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c.329572d6-7e9f-41e3-9126-6ca5048a9f2a" returned: 0 in 0.342s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:35 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [req-1bc31786-cedc-47a6-98bc-251aa5053f78 req-f49d269e-d755-42dd-8c3c-ff5d25dfd881 tempest-VolumesSnapshotsTestJSON-862480745 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c.329572d6-7e9f-41e3-9126-6ca5048a9f2a is being set with open permissions: ugo+rw Sep 21 11:59:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-1bc31786-cedc-47a6-98bc-251aa5053f78 req-f49d269e-d755-42dd-8c3c-ff5d25dfd881 tempest-VolumesSnapshotsTestJSON-862480745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c.329572d6-7e9f-41e3-9126-6ca5048a9f2a {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:35 devstack sudo[96495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c.329572d6-7e9f-41e3-9126-6ca5048a9f2a Sep 21 11:59:35 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:35 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e6376851-eae0-4baa-93cb-11caf5c41035 tempest-VolumesCloneTest-1563314939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.249s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:35 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-e6376851-eae0-4baa-93cb-11caf5c41035 tempest-VolumesCloneTest-1563314939 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:59:35 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-e6376851-eae0-4baa-93cb-11caf5c41035 tempest-VolumesCloneTest-1563314939 None] Deleted volume successfully. Sep 21 11:59:35 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e6376851-eae0-4baa-93cb-11caf5c41035 tempest-VolumesCloneTest-1563314939 None] Lock "cinder-e7200dff-e07d-49a8-93f0-22fab1694f0f-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:35 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-1bc31786-cedc-47a6-98bc-251aa5053f78 req-f49d269e-d755-42dd-8c3c-ff5d25dfd881 tempest-VolumesSnapshotsTestJSON-862480745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c.329572d6-7e9f-41e3-9126-6ca5048a9f2a" returned: 0 in 0.252s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-1bc31786-cedc-47a6-98bc-251aa5053f78 req-f49d269e-d755-42dd-8c3c-ff5d25dfd881 tempest-VolumesSnapshotsTestJSON-862480745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:35 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c.info Sep 21 11:59:35 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:35 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-1bc31786-cedc-47a6-98bc-251aa5053f78 req-f49d269e-d755-42dd-8c3c-ff5d25dfd881 tempest-VolumesSnapshotsTestJSON-862480745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c.info" returned: 0 in 0.257s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:35 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [req-1bc31786-cedc-47a6-98bc-251aa5053f78 req-f49d269e-d755-42dd-8c3c-ff5d25dfd881 tempest-VolumesSnapshotsTestJSON-862480745 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c.info is being set with open permissions: ugo+rw Sep 21 11:59:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-1bc31786-cedc-47a6-98bc-251aa5053f78 req-f49d269e-d755-42dd-8c3c-ff5d25dfd881 tempest-VolumesSnapshotsTestJSON-862480745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:35 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c.info Sep 21 11:59:35 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:35 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-1bc31786-cedc-47a6-98bc-251aa5053f78 req-f49d269e-d755-42dd-8c3c-ff5d25dfd881 tempest-VolumesSnapshotsTestJSON-862480745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c.info" returned: 0 in 0.273s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-1bc31786-cedc-47a6-98bc-251aa5053f78 req-f49d269e-d755-42dd-8c3c-ff5d25dfd881 tempest-VolumesSnapshotsTestJSON-862480745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.276s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.104s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1800749407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc685545-a918-4910-9bc9-abd27ae9a818,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b21e9844845c423b979638bf4dd80987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:59:35Z,use_quota=True,user_id='31e9c4a43ad7480f8aa37b41ab5b66f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:59:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Creating volume fc685545-a918-4910-9bc9-abd27ae9a818 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:59:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:59:35 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:59:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-fc685545-a918-4910-9bc9-abd27ae9a818 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:36 devstack sudo[96505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-fc685545-a918-4910-9bc9-abd27ae9a818 1073741824 Sep 21 11:59:36 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:36 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-1bc31786-cedc-47a6-98bc-251aa5053f78 req-f49d269e-d755-42dd-8c3c-ff5d25dfd881 tempest-VolumesSnapshotsTestJSON-862480745 None] Create snapshot completed successfully Sep 21 11:59:36 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-fc685545-a918-4910-9bc9-abd27ae9a818 1073741824" returned: 0 in 0.530s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-fc685545-a918-4910-9bc9-abd27ae9a818 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:36 devstack sudo[96512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-fc685545-a918-4910-9bc9-abd27ae9a818 Sep 21 11:59:36 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:36 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-19b3a6c1-3571-4d35-876d-70e7d506cdfd tempest-GroupsTest-1078100098 None] Acquiring lock "cinder-quobyte-e32a53e6-26cf-4abf-a2e1-e3ce2cff5647" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:36 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-19b3a6c1-3571-4d35-876d-70e7d506cdfd tempest-GroupsTest-1078100098 None] Lock "cinder-quobyte-e32a53e6-26cf-4abf-a2e1-e3ce2cff5647" acquired by "delete_volume" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:36 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[42941ea8-f8cf-4b28-a073-2912ea5f5ec5]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-19b3a6c1-3571-4d35-876d-70e7d506cdfd tempest-GroupsTest-1078100098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e32a53e6-26cf-4abf-a2e1-e3ce2cff5647 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:36 devstack sudo[96514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e32a53e6-26cf-4abf-a2e1-e3ce2cff5647 Sep 21 11:59:36 devstack sudo[96514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:36 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-fc685545-a918-4910-9bc9-abd27ae9a818" returned: 0 in 0.339s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:36 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:59:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:36 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e1265eb-7de1-4fa9-a9b1-155f4102fb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc685545-a918-4910-9bc9-abd27ae9a818', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:36 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28bd7e9-82d7-45cf-8fa3-882d897a0a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:36 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Volume volume-fc685545-a918-4910-9bc9-abd27ae9a818 (fc685545-a918-4910-9bc9-abd27ae9a818): created successfully Sep 21 11:59:36 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28bd7e9-82d7-45cf-8fa3-882d897a0a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:36 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Flow 'volume_create_manager' (81b07878-1440-4279-b57a-df04a071b8f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:59:36 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-98fc0efa-cfd4-4653-9951-7eafebeb010c tempest-VolumesListTestJSON-128925852 None] Created volume successfully. Sep 21 11:59:36 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-d339ac21-5a24-4228-ba80-074725fad93d req-d3b73501-2920-47c2-b30a-f47fbb52b7f9 tempest-VolumesSnapshotsTestJSON-862480745 None] Acquiring lock "cinder-329572d6-7e9f-41e3-9126-6ca5048a9f2a-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-d339ac21-5a24-4228-ba80-074725fad93d req-d3b73501-2920-47c2-b30a-f47fbb52b7f9 tempest-VolumesSnapshotsTestJSON-862480745 None] Lock "cinder-329572d6-7e9f-41e3-9126-6ca5048a9f2a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-d339ac21-5a24-4228-ba80-074725fad93d req-d3b73501-2920-47c2-b30a-f47fbb52b7f9 tempest-VolumesSnapshotsTestJSON-862480745 None] Acquiring lock "cinder-quobyte-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-d339ac21-5a24-4228-ba80-074725fad93d req-d3b73501-2920-47c2-b30a-f47fbb52b7f9 tempest-VolumesSnapshotsTestJSON-862480745 None] Lock "cinder-quobyte-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-d339ac21-5a24-4228-ba80-074725fad93d req-d3b73501-2920-47c2-b30a-f47fbb52b7f9 tempest-VolumesSnapshotsTestJSON-862480745 None] Acquiring lock "cinder-quobyte-329572d6-7e9f-41e3-9126-6ca5048a9f2a" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-d339ac21-5a24-4228-ba80-074725fad93d req-d3b73501-2920-47c2-b30a-f47fbb52b7f9 tempest-VolumesSnapshotsTestJSON-862480745 None] Lock "cinder-quobyte-329572d6-7e9f-41e3-9126-6ca5048a9f2a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:37 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [req-d339ac21-5a24-4228-ba80-074725fad93d req-d3b73501-2920-47c2-b30a-f47fbb52b7f9 tempest-VolumesSnapshotsTestJSON-862480745 None] Deleting offline snapshot 329572d6-7e9f-41e3-9126-6ca5048a9f2a of volume 2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 11:59:37 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [req-d339ac21-5a24-4228-ba80-074725fad93d req-d3b73501-2920-47c2-b30a-f47fbb52b7f9 tempest-VolumesSnapshotsTestJSON-862480745 None] snapshot_file for this snap is: volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c.329572d6-7e9f-41e3-9126-6ca5048a9f2a {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 11:59:37 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47071a2-db3c-4811-85f3-90d5dfef25b7]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-d339ac21-5a24-4228-ba80-074725fad93d req-d3b73501-2920-47c2-b30a-f47fbb52b7f9 tempest-VolumesSnapshotsTestJSON-862480745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c.329572d6-7e9f-41e3-9126-6ca5048a9f2a {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:37 devstack sudo[96514]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-19b3a6c1-3571-4d35-876d-70e7d506cdfd tempest-GroupsTest-1078100098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e32a53e6-26cf-4abf-a2e1-e3ce2cff5647" returned: 0 in 0.486s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-19b3a6c1-3571-4d35-876d-70e7d506cdfd tempest-GroupsTest-1078100098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e32a53e6-26cf-4abf-a2e1-e3ce2cff5647 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:37 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c.329572d6-7e9f-41e3-9126-6ca5048a9f2a Sep 21 11:59:37 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:37 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e32a53e6-26cf-4abf-a2e1-e3ce2cff5647 Sep 21 11:59:37 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:37 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-19b3a6c1-3571-4d35-876d-70e7d506cdfd tempest-GroupsTest-1078100098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e32a53e6-26cf-4abf-a2e1-e3ce2cff5647" returned: 0 in 0.326s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:37 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-d339ac21-5a24-4228-ba80-074725fad93d req-d3b73501-2920-47c2-b30a-f47fbb52b7f9 tempest-VolumesSnapshotsTestJSON-862480745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c.329572d6-7e9f-41e3-9126-6ca5048a9f2a" returned: 0 in 0.454s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:37 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [req-d339ac21-5a24-4228-ba80-074725fad93d req-d3b73501-2920-47c2-b30a-f47fbb52b7f9 tempest-VolumesSnapshotsTestJSON-862480745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 11:59:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-19b3a6c1-3571-4d35-876d-70e7d506cdfd tempest-GroupsTest-1078100098 None] Lock "cinder-quobyte-e32a53e6-26cf-4abf-a2e1-e3ce2cff5647" released by "delete_volume" :: held 0.907s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-19b3a6c1-3571-4d35-876d-70e7d506cdfd tempest-GroupsTest-1078100098 None] Acquiring lock "cinder-quobyte-f7570db0-d6e9-40d5-819a-bbfca36f0561" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-19b3a6c1-3571-4d35-876d-70e7d506cdfd tempest-GroupsTest-1078100098 None] Lock "cinder-quobyte-f7570db0-d6e9-40d5-819a-bbfca36f0561" acquired by "delete_volume" :: waited 0.017s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:37 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b8d6b2-bb97-4e33-8201-c40f6f29c460]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-d339ac21-5a24-4228-ba80-074725fad93d req-d3b73501-2920-47c2-b30a-f47fbb52b7f9 tempest-VolumesSnapshotsTestJSON-862480745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:37 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1884bbc-d9d9-40dc-b798-2953d5a6d863]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-19b3a6c1-3571-4d35-876d-70e7d506cdfd tempest-GroupsTest-1078100098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f7570db0-d6e9-40d5-819a-bbfca36f0561 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:37 devstack sudo[96528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c Sep 21 11:59:37 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:37 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f7570db0-d6e9-40d5-819a-bbfca36f0561 Sep 21 11:59:37 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:38 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-19b3a6c1-3571-4d35-876d-70e7d506cdfd tempest-GroupsTest-1078100098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f7570db0-d6e9-40d5-819a-bbfca36f0561" returned: 0 in 0.543s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-19b3a6c1-3571-4d35-876d-70e7d506cdfd tempest-GroupsTest-1078100098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f7570db0-d6e9-40d5-819a-bbfca36f0561 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:38 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f7570db0-d6e9-40d5-819a-bbfca36f0561 Sep 21 11:59:38 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:38 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-d339ac21-5a24-4228-ba80-074725fad93d req-d3b73501-2920-47c2-b30a-f47fbb52b7f9 tempest-VolumesSnapshotsTestJSON-862480745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c" returned: 0 in 0.691s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-d339ac21-5a24-4228-ba80-074725fad93d req-d3b73501-2920-47c2-b30a-f47fbb52b7f9 tempest-VolumesSnapshotsTestJSON-862480745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c.329572d6-7e9f-41e3-9126-6ca5048a9f2a {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:38 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c.329572d6-7e9f-41e3-9126-6ca5048a9f2a Sep 21 11:59:38 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:38 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-19b3a6c1-3571-4d35-876d-70e7d506cdfd tempest-GroupsTest-1078100098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f7570db0-d6e9-40d5-819a-bbfca36f0561" returned: 0 in 0.369s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-19b3a6c1-3571-4d35-876d-70e7d506cdfd tempest-GroupsTest-1078100098 None] Lock "cinder-quobyte-f7570db0-d6e9-40d5-819a-bbfca36f0561" released by "delete_volume" :: held 0.971s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-19b3a6c1-3571-4d35-876d-70e7d506cdfd tempest-GroupsTest-1078100098 None] Created reservations ['26b7df95-8b18-48d2-8754-6e455ba0b03f'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:59:38 devstack cinder-volume[86366]: WARNING cinder.quota [None req-19b3a6c1-3571-4d35-876d-70e7d506cdfd tempest-GroupsTest-1078100098 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-306975043 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-306975043, it is now deprecated. Please use the default quota class for default quota. Sep 21 11:59:38 devstack cinder-volume[86366]: WARNING cinder.quota [None req-19b3a6c1-3571-4d35-876d-70e7d506cdfd tempest-GroupsTest-1078100098 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-306975043 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-306975043, it is now deprecated. Please use the default quota class for default quota. Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-19b3a6c1-3571-4d35-876d-70e7d506cdfd tempest-GroupsTest-1078100098 None] Created reservations ['eb710efd-08d4-456b-8e78-83d1d024261b', '90972d59-d287-49d7-a166-1f156533e7dd', '4470845a-e888-414f-a8c0-c3ea340254f5', '68c8d692-5935-466d-9b62-23a694d07dac'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:59:38 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Flow 'volume_create_manager' (28c7ff1a-6729-4679-a48c-032924258ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9268aee2-311a-408f-9c82-7e486a42c5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-d339ac21-5a24-4228-ba80-074725fad93d req-d3b73501-2920-47c2-b30a-f47fbb52b7f9 tempest-VolumesSnapshotsTestJSON-862480745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c.329572d6-7e9f-41e3-9126-6ca5048a9f2a" returned: 0 in 0.509s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-d339ac21-5a24-4228-ba80-074725fad93d req-d3b73501-2920-47c2-b30a-f47fbb52b7f9 tempest-VolumesSnapshotsTestJSON-862480745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c.329572d6-7e9f-41e3-9126-6ca5048a9f2a {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:38 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c.329572d6-7e9f-41e3-9126-6ca5048a9f2a Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9268aee2-311a-408f-9c82-7e486a42c5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1499992092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=078abe6a-9501-4250-8d7c-b8256aa6c1f4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b21e9844845c423b979638bf4dd80987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:59:39Z,use_quota=True,user_id='31e9c4a43ad7480f8aa37b41ab5b66f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:38 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62265b91-4eb4-44b9-bd1c-21e92b1c6040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62265b91-4eb4-44b9-bd1c-21e92b1c6040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a83ef579-64a6-4be4-8896-df7feb80ef2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a83ef579-64a6-4be4-8896-df7feb80ef2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '078abe6a-9501-4250-8d7c-b8256aa6c1f4', 'volume_name': 'volume-078abe6a-9501-4250-8d7c-b8256aa6c1f4', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (540960c3-fb54-4478-93a4-8b372e65f657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (540960c3-fb54-4478-93a4-8b372e65f657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1791915e-3d74-4d2a-9e61-ad326860f98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:38 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Volume 078abe6a-9501-4250-8d7c-b8256aa6c1f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-078abe6a-9501-4250-8d7c-b8256aa6c1f4', 'volume_size': 1} Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1499992092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=078abe6a-9501-4250-8d7c-b8256aa6c1f4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b21e9844845c423b979638bf4dd80987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:59:39Z,use_quota=True,user_id='31e9c4a43ad7480f8aa37b41ab5b66f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Creating volume 078abe6a-9501-4250-8d7c-b8256aa6c1f4 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:59:38 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:59:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-078abe6a-9501-4250-8d7c-b8256aa6c1f4 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:38 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-078abe6a-9501-4250-8d7c-b8256aa6c1f4 1073741824 Sep 21 11:59:38 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:39 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-19b3a6c1-3571-4d35-876d-70e7d506cdfd tempest-GroupsTest-1078100098 None] Created reservations ['ce033293-c84e-4038-8402-60ce0e63b9d3', 'd9d10c03-f4d1-4566-9da5-6bba998d2ba2', 'd676f044-3535-46e1-ac11-e45eeea6c0ac', '02f09069-a4bc-4c3d-b7a0-10190d30fe59'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:59:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-19b3a6c1-3571-4d35-876d-70e7d506cdfd tempest-GroupsTest-1078100098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-19b3a6c1-3571-4d35-876d-70e7d506cdfd tempest-GroupsTest-1078100098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:39 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-19b3a6c1-3571-4d35-876d-70e7d506cdfd tempest-GroupsTest-1078100098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:39 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-19b3a6c1-3571-4d35-876d-70e7d506cdfd tempest-GroupsTest-1078100098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-19b3a6c1-3571-4d35-876d-70e7d506cdfd tempest-GroupsTest-1078100098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-19b3a6c1-3571-4d35-876d-70e7d506cdfd tempest-GroupsTest-1078100098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:39 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:59:39 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:39 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-d339ac21-5a24-4228-ba80-074725fad93d req-d3b73501-2920-47c2-b30a-f47fbb52b7f9 tempest-VolumesSnapshotsTestJSON-862480745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c.329572d6-7e9f-41e3-9126-6ca5048a9f2a" returned: 0 in 0.471s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:39 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-d339ac21-5a24-4228-ba80-074725fad93d req-d3b73501-2920-47c2-b30a-f47fbb52b7f9 tempest-VolumesSnapshotsTestJSON-862480745 None] Lock "cinder-quobyte-329572d6-7e9f-41e3-9126-6ca5048a9f2a" released by "_delete_snapshot" :: held 2.309s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:39 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-d339ac21-5a24-4228-ba80-074725fad93d req-d3b73501-2920-47c2-b30a-f47fbb52b7f9 tempest-VolumesSnapshotsTestJSON-862480745 None] Lock "cinder-quobyte-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c" released by "delete_snapshot" :: held 2.335s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:39 devstack cinder-volume[86366]: WARNING cinder.quota [req-d339ac21-5a24-4228-ba80-074725fad93d req-d3b73501-2920-47c2-b30a-f47fbb52b7f9 tempest-VolumesSnapshotsTestJSON-862480745 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 21 11:59:39 devstack cinder-volume[86366]: DEBUG cinder.quota [req-d339ac21-5a24-4228-ba80-074725fad93d req-d3b73501-2920-47c2-b30a-f47fbb52b7f9 tempest-VolumesSnapshotsTestJSON-862480745 None] Created reservations ['0deec568-5dad-42f0-959e-1093b93d85f8', 'fa65b5c4-7f7e-4638-8a10-1e622b3ed98e', '1512d559-e75e-41cd-b66a-ed52e040481a', 'f15236ff-741c-4d9b-9264-aa25494b1e23'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:59:39 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-d339ac21-5a24-4228-ba80-074725fad93d req-d3b73501-2920-47c2-b30a-f47fbb52b7f9 tempest-VolumesSnapshotsTestJSON-862480745 None] Delete snapshot completed successfully. Sep 21 11:59:39 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-d339ac21-5a24-4228-ba80-074725fad93d req-d3b73501-2920-47c2-b30a-f47fbb52b7f9 tempest-VolumesSnapshotsTestJSON-862480745 None] Lock "cinder-329572d6-7e9f-41e3-9126-6ca5048a9f2a-delete_snapshot" released by "delete_snapshot" :: held 2.569s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:39 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-19b3a6c1-3571-4d35-876d-70e7d506cdfd tempest-GroupsTest-1078100098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.413s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:39 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-19b3a6c1-3571-4d35-876d-70e7d506cdfd tempest-GroupsTest-1078100098 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:59:39 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-19b3a6c1-3571-4d35-876d-70e7d506cdfd tempest-GroupsTest-1078100098 None] Delete group completed successfully. Sep 21 11:59:39 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-078abe6a-9501-4250-8d7c-b8256aa6c1f4 1073741824" returned: 0 in 0.798s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-078abe6a-9501-4250-8d7c-b8256aa6c1f4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:39 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-078abe6a-9501-4250-8d7c-b8256aa6c1f4 Sep 21 11:59:39 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:40 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-078abe6a-9501-4250-8d7c-b8256aa6c1f4" returned: 0 in 0.281s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:40 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:59:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:40 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1791915e-3d74-4d2a-9e61-ad326860f98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-078abe6a-9501-4250-8d7c-b8256aa6c1f4', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:40 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bee0fdb-06f8-410c-8654-8be1055c0f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:40 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Volume volume-078abe6a-9501-4250-8d7c-b8256aa6c1f4 (078abe6a-9501-4250-8d7c-b8256aa6c1f4): created successfully Sep 21 11:59:40 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bee0fdb-06f8-410c-8654-8be1055c0f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:40 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Flow 'volume_create_manager' (28c7ff1a-6729-4679-a48c-032924258ee3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:59:40 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-c3703f55-f856-49b5-bf7a-d13a188effcf tempest-VolumesListTestJSON-128925852 None] Created volume successfully. Sep 21 11:59:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-d3dbfa1e-6a3b-473f-9b18-17a0847d39f2 req-5fd22a74-6475-4b2f-9fb2-916becf08293 tempest-VolumesSnapshotsTestJSON-862480745 None] Acquiring lock "cinder-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-d3dbfa1e-6a3b-473f-9b18-17a0847d39f2 req-5fd22a74-6475-4b2f-9fb2-916becf08293 tempest-VolumesSnapshotsTestJSON-862480745 None] Lock "cinder-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-d3dbfa1e-6a3b-473f-9b18-17a0847d39f2 req-5fd22a74-6475-4b2f-9fb2-916becf08293 tempest-VolumesSnapshotsTestJSON-862480745 None] Acquiring lock "cinder-quobyte-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-d3dbfa1e-6a3b-473f-9b18-17a0847d39f2 req-5fd22a74-6475-4b2f-9fb2-916becf08293 tempest-VolumesSnapshotsTestJSON-862480745 None] Lock "cinder-quobyte-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c" acquired by "delete_volume" :: waited 0.021s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:40 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d57b29-7e31-4844-990d-dcfd55979366]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-d3dbfa1e-6a3b-473f-9b18-17a0847d39f2 req-5fd22a74-6475-4b2f-9fb2-916becf08293 tempest-VolumesSnapshotsTestJSON-862480745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:40 devstack sudo[96562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c Sep 21 11:59:40 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:41 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-d3dbfa1e-6a3b-473f-9b18-17a0847d39f2 req-5fd22a74-6475-4b2f-9fb2-916becf08293 tempest-VolumesSnapshotsTestJSON-862480745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c" returned: 0 in 0.487s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-d3dbfa1e-6a3b-473f-9b18-17a0847d39f2 req-5fd22a74-6475-4b2f-9fb2-916becf08293 tempest-VolumesSnapshotsTestJSON-862480745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:41 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c Sep 21 11:59:41 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:41 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-d3dbfa1e-6a3b-473f-9b18-17a0847d39f2 req-5fd22a74-6475-4b2f-9fb2-916becf08293 tempest-VolumesSnapshotsTestJSON-862480745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c" returned: 0 in 0.419s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:41 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-d3dbfa1e-6a3b-473f-9b18-17a0847d39f2 req-5fd22a74-6475-4b2f-9fb2-916becf08293 tempest-VolumesSnapshotsTestJSON-862480745 None] Lock "cinder-quobyte-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c" released by "delete_volume" :: held 1.015s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:41 devstack cinder-volume[86366]: DEBUG cinder.quota [req-d3dbfa1e-6a3b-473f-9b18-17a0847d39f2 req-5fd22a74-6475-4b2f-9fb2-916becf08293 tempest-VolumesSnapshotsTestJSON-862480745 None] Created reservations ['df09c880-ee8e-4e97-94d1-026f36e6ea5f', '13d9d420-9931-484a-9447-62db1c506c4b', 'b0517971-e540-43e0-ba7e-0cff2345b401', 'f4e15983-7846-47c3-bdf4-7e9f954e51a1'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:59:41 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:59:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Flow 'volume_create_manager' (b337ceaa-7f8d-41d5-9b58-8c267d857297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:59:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac826c12-9814-409f-a5b4-3c49f2b71c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac826c12-9814-409f-a5b4-3c49f2b71c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1382410951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97600dc6-b927-4c50-b826-d8c83fb494de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c2f87b3686423482492bb45ce67b17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:59:42Z,use_quota=True,user_id='3fca0478901b4b5d96fad9ceb2fc57b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff337fd-1756-4895-a530-ae6ad2d4eddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff337fd-1756-4895-a530-ae6ad2d4eddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4508a52d-862a-4ea7-8720-59bcc4d34491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:41 devstack cinder-volume[86366]: DEBUG cinder.image.glance [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Creating Keystone auth plugin from conf {{(pid=86366) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 21 11:59:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-d3dbfa1e-6a3b-473f-9b18-17a0847d39f2 req-5fd22a74-6475-4b2f-9fb2-916becf08293 tempest-VolumesSnapshotsTestJSON-862480745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-d3dbfa1e-6a3b-473f-9b18-17a0847d39f2 req-5fd22a74-6475-4b2f-9fb2-916becf08293 tempest-VolumesSnapshotsTestJSON-862480745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:41 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [req-d3dbfa1e-6a3b-473f-9b18-17a0847d39f2 req-5fd22a74-6475-4b2f-9fb2-916becf08293 tempest-VolumesSnapshotsTestJSON-862480745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:41 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [req-d3dbfa1e-6a3b-473f-9b18-17a0847d39f2 req-5fd22a74-6475-4b2f-9fb2-916becf08293 tempest-VolumesSnapshotsTestJSON-862480745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-d3dbfa1e-6a3b-473f-9b18-17a0847d39f2 req-5fd22a74-6475-4b2f-9fb2-916becf08293 tempest-VolumesSnapshotsTestJSON-862480745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-d3dbfa1e-6a3b-473f-9b18-17a0847d39f2 req-5fd22a74-6475-4b2f-9fb2-916becf08293 tempest-VolumesSnapshotsTestJSON-862480745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:41 devstack sudo[96570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:59:41 devstack sudo[96570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:42 devstack sudo[96570]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-d3dbfa1e-6a3b-473f-9b18-17a0847d39f2 req-5fd22a74-6475-4b2f-9fb2-916becf08293 tempest-VolumesSnapshotsTestJSON-862480745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.420s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:42 devstack cinder-volume[86366]: DEBUG cinder.manager [req-d3dbfa1e-6a3b-473f-9b18-17a0847d39f2 req-5fd22a74-6475-4b2f-9fb2-916becf08293 tempest-VolumesSnapshotsTestJSON-862480745 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:59:42 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-d3dbfa1e-6a3b-473f-9b18-17a0847d39f2 req-5fd22a74-6475-4b2f-9fb2-916becf08293 tempest-VolumesSnapshotsTestJSON-862480745 None] Deleted volume successfully. Sep 21 11:59:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-d3dbfa1e-6a3b-473f-9b18-17a0847d39f2 req-5fd22a74-6475-4b2f-9fb2-916becf08293 tempest-VolumesSnapshotsTestJSON-862480745 None] Lock "cinder-2384ee98-d3aa-49ff-9b0f-8b1ebcb5a86c-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4508a52d-862a-4ea7-8720-59bcc4d34491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '97600dc6-b927-4c50-b826-d8c83fb494de', 'volume_name': 'volume-97600dc6-b927-4c50-b826-d8c83fb494de', 'volume_size': 1, 'image_id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6c23462c1d34d9a9d8fbc8d8872d421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'created_at': datetime.datetime(2026, 9, 21, 9, 44, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 9, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab61bf13-1a38-4cc6-82e6-9eda9848ac57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab61bf13-1a38-4cc6-82e6-9eda9848ac57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec5360d-510a-4444-be98-373fe6c43442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:42 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Volume 97600dc6-b927-4c50-b826-d8c83fb494de: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-97600dc6-b927-4c50-b826-d8c83fb494de', 'volume_size': 1, 'image_id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6c23462c1d34d9a9d8fbc8d8872d421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'created_at': datetime.datetime(2026, 9, 21, 9, 44, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 9, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 21 11:59:42 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Trying to clone 97600dc6-b927-4c50-b826-d8c83fb494de from image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}]). {{(pid=86366) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 21 11:59:43 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_xtayvs5xdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 21 11:59:43 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Image download 20.69 MB at 20.69 MB/s Sep 21 11:59:43 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[5416fe52-9b04-477e-be63-acbb3ac904dd]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_xtayvs5xdevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:43 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_xtayvs5xdevstack@QuobyteHD Sep 21 11:59:43 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:43 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-8c5b7cf9-13bd-4d33-a74d-67db55d351ba tempest-VolumesListTestJSON-128925852 None] Acquiring lock "cinder-078abe6a-9501-4250-8d7c-b8256aa6c1f4-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:43 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-8c5b7cf9-13bd-4d33-a74d-67db55d351ba tempest-VolumesListTestJSON-128925852 None] Lock "cinder-078abe6a-9501-4250-8d7c-b8256aa6c1f4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:43 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:UPDATE=172,cinder:INSERT=39,cinder:DELETE=13,cinder:SELECT=125 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:59:43 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_xtayvs5xdevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:43 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Temporary image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 is fetched for user 3fca0478901b4b5d96fad9ceb2fc57b1. {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 21 11:59:43 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=132,cinder:UPDATE=169,cinder:DELETE=13,cinder:INSERT=38 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 11:59:43 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-8c5b7cf9-13bd-4d33-a74d-67db55d351ba tempest-VolumesListTestJSON-128925852 None] Acquiring lock "cinder-quobyte-078abe6a-9501-4250-8d7c-b8256aa6c1f4" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:43 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-8c5b7cf9-13bd-4d33-a74d-67db55d351ba tempest-VolumesListTestJSON-128925852 None] Lock "cinder-quobyte-078abe6a-9501-4250-8d7c-b8256aa6c1f4" acquired by "delete_volume" :: waited 0.032s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:43 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84e4e02-1415-4621-bb9b-df224057f4a6]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_xtayvs5xdevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:43 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[47134dbd-62dd-4a75-ada2-57d93bec23be]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-8c5b7cf9-13bd-4d33-a74d-67db55d351ba tempest-VolumesListTestJSON-128925852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-078abe6a-9501-4250-8d7c-b8256aa6c1f4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:44 devstack sudo[96581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_xtayvs5xdevstack@QuobyteHD Sep 21 11:59:44 devstack sudo[96581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:44 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-078abe6a-9501-4250-8d7c-b8256aa6c1f4 Sep 21 11:59:44 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:44 devstack sudo[96581]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_xtayvs5xdevstack@QuobyteHD" returned: 0 in 0.443s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1382410951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97600dc6-b927-4c50-b826-d8c83fb494de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c2f87b3686423482492bb45ce67b17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:59:42Z,use_quota=True,user_id='3fca0478901b4b5d96fad9ceb2fc57b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:59:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Creating volume 97600dc6-b927-4c50-b826-d8c83fb494de {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:59:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:59:44 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:59:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-97600dc6-b927-4c50-b826-d8c83fb494de 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:44 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-8c5b7cf9-13bd-4d33-a74d-67db55d351ba tempest-VolumesListTestJSON-128925852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-078abe6a-9501-4250-8d7c-b8256aa6c1f4" returned: 0 in 0.483s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-8c5b7cf9-13bd-4d33-a74d-67db55d351ba tempest-VolumesListTestJSON-128925852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-078abe6a-9501-4250-8d7c-b8256aa6c1f4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:44 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-97600dc6-b927-4c50-b826-d8c83fb494de 1073741824 Sep 21 11:59:44 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:44 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-078abe6a-9501-4250-8d7c-b8256aa6c1f4 Sep 21 11:59:44 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:44 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-8c5b7cf9-13bd-4d33-a74d-67db55d351ba tempest-VolumesListTestJSON-128925852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-078abe6a-9501-4250-8d7c-b8256aa6c1f4" returned: 0 in 0.407s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:44 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-8c5b7cf9-13bd-4d33-a74d-67db55d351ba tempest-VolumesListTestJSON-128925852 None] Lock "cinder-quobyte-078abe6a-9501-4250-8d7c-b8256aa6c1f4" released by "delete_volume" :: held 0.968s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:44 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-8c5b7cf9-13bd-4d33-a74d-67db55d351ba tempest-VolumesListTestJSON-128925852 None] Created reservations ['7179b9f1-6ac5-41ad-8ba0-088c00133768', 'fd7f6f04-b2bb-4f15-b0b9-587e829320fb', '34010e01-827f-4fcf-b677-9acccdf53a10', '4971f3ff-9946-48a2-9487-31ca6520d099'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:59:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-8c5b7cf9-13bd-4d33-a74d-67db55d351ba tempest-VolumesListTestJSON-128925852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-8c5b7cf9-13bd-4d33-a74d-67db55d351ba tempest-VolumesListTestJSON-128925852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-8c5b7cf9-13bd-4d33-a74d-67db55d351ba tempest-VolumesListTestJSON-128925852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-8c5b7cf9-13bd-4d33-a74d-67db55d351ba tempest-VolumesListTestJSON-128925852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-8c5b7cf9-13bd-4d33-a74d-67db55d351ba tempest-VolumesListTestJSON-128925852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-8c5b7cf9-13bd-4d33-a74d-67db55d351ba tempest-VolumesListTestJSON-128925852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:45 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:59:45 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:45 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-97600dc6-b927-4c50-b826-d8c83fb494de 1073741824" returned: 0 in 0.721s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-97600dc6-b927-4c50-b826-d8c83fb494de {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:45 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-97600dc6-b927-4c50-b826-d8c83fb494de Sep 21 11:59:45 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:45 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-8c5b7cf9-13bd-4d33-a74d-67db55d351ba tempest-VolumesListTestJSON-128925852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.292s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:45 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-8c5b7cf9-13bd-4d33-a74d-67db55d351ba tempest-VolumesListTestJSON-128925852 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:59:45 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-8c5b7cf9-13bd-4d33-a74d-67db55d351ba tempest-VolumesListTestJSON-128925852 None] Deleted volume successfully. Sep 21 11:59:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-8c5b7cf9-13bd-4d33-a74d-67db55d351ba tempest-VolumesListTestJSON-128925852 None] Lock "cinder-078abe6a-9501-4250-8d7c-b8256aa6c1f4-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:45 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-97600dc6-b927-4c50-b826-d8c83fb494de" returned: 0 in 0.317s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:59:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:45 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Attempting download of 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 ((None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}])) to volume 97600dc6-b927-4c50-b826-d8c83fb494de. {{(pid=86366) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 21 11:59:45 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[da94087e-db98-4da6-940d-0817fc7c4d4d]: (4, 'raw') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_wwqiqxvf {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:45 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_wwqiqxvf Sep 21 11:59:45 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:45 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_wwqiqxvf" returned: 0 in 0.366s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_wwqiqxvf {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:46 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_wwqiqxvf Sep 21 11:59:46 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:46 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0866205c-2169-459d-af07-bdbc05d667ba tempest-VolumesListTestJSON-128925852 None] Acquiring lock "cinder-fc685545-a918-4910-9bc9-abd27ae9a818-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:46 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0866205c-2169-459d-af07-bdbc05d667ba tempest-VolumesListTestJSON-128925852 None] Lock "cinder-fc685545-a918-4910-9bc9-abd27ae9a818-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:46 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0866205c-2169-459d-af07-bdbc05d667ba tempest-VolumesListTestJSON-128925852 None] Acquiring lock "cinder-quobyte-fc685545-a918-4910-9bc9-abd27ae9a818" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:46 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0866205c-2169-459d-af07-bdbc05d667ba tempest-VolumesListTestJSON-128925852 None] Lock "cinder-quobyte-fc685545-a918-4910-9bc9-abd27ae9a818" acquired by "delete_volume" :: waited 0.033s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:46 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd077ccd-d82a-4f38-ab69-1234ac4f1363]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0866205c-2169-459d-af07-bdbc05d667ba tempest-VolumesListTestJSON-128925852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-fc685545-a918-4910-9bc9-abd27ae9a818 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:46 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_wwqiqxvf" returned: 1 in 0.459s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_wwqiqxvf' failed. Not Retrying. {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 11:59:46 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77a9c8b-00d1-4b88-847d-659f802f3bec]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_xtayvs5xdevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:46 devstack sudo[96615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-fc685545-a918-4910-9bc9-abd27ae9a818 Sep 21 11:59:46 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:46 devstack sudo[96616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_xtayvs5xdevstack@QuobyteHD Sep 21 11:59:46 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:46 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0866205c-2169-459d-af07-bdbc05d667ba tempest-VolumesListTestJSON-128925852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-fc685545-a918-4910-9bc9-abd27ae9a818" returned: 0 in 0.428s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0866205c-2169-459d-af07-bdbc05d667ba tempest-VolumesListTestJSON-128925852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-fc685545-a918-4910-9bc9-abd27ae9a818 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:46 devstack sudo[96626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-fc685545-a918-4910-9bc9-abd27ae9a818 Sep 21 11:59:46 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:46 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_xtayvs5xdevstack@QuobyteHD" returned: 0 in 0.446s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:46 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 was qcow2, converting to qcow2 {{(pid=86366) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 21 11:59:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_xtayvs5xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-97600dc6-b927-4c50-b826-d8c83fb494de {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:46 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_xtayvs5xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-97600dc6-b927-4c50-b826-d8c83fb494de Sep 21 11:59:46 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:47 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0866205c-2169-459d-af07-bdbc05d667ba tempest-VolumesListTestJSON-128925852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-fc685545-a918-4910-9bc9-abd27ae9a818" returned: 0 in 0.337s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0866205c-2169-459d-af07-bdbc05d667ba tempest-VolumesListTestJSON-128925852 None] Lock "cinder-quobyte-fc685545-a918-4910-9bc9-abd27ae9a818" released by "delete_volume" :: held 0.843s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:47 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-0866205c-2169-459d-af07-bdbc05d667ba tempest-VolumesListTestJSON-128925852 None] Created reservations ['f83d482d-9ef2-4d48-b780-bdcb0088d8d8', '882c0d77-e35b-4f9b-95f7-5cf449e3f357', '3245ea70-3dcf-4934-82d6-f1b0fb2907f6', 'c4e1cd11-2c08-4455-8de8-21db9b8a733b'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:59:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0866205c-2169-459d-af07-bdbc05d667ba tempest-VolumesListTestJSON-128925852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0866205c-2169-459d-af07-bdbc05d667ba tempest-VolumesListTestJSON-128925852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:47 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0866205c-2169-459d-af07-bdbc05d667ba tempest-VolumesListTestJSON-128925852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:47 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0866205c-2169-459d-af07-bdbc05d667ba tempest-VolumesListTestJSON-128925852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0866205c-2169-459d-af07-bdbc05d667ba tempest-VolumesListTestJSON-128925852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0866205c-2169-459d-af07-bdbc05d667ba tempest-VolumesListTestJSON-128925852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:47 devstack sudo[96635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:59:47 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f6509645-7438-4ff2-972d-858652dace58 tempest-VolumesListTestJSON-128925852 None] Acquiring lock "cinder-6943fa32-7abb-44a1-88a2-78f0803b0240-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f6509645-7438-4ff2-972d-858652dace58 tempest-VolumesListTestJSON-128925852 None] Lock "cinder-6943fa32-7abb-44a1-88a2-78f0803b0240-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f6509645-7438-4ff2-972d-858652dace58 tempest-VolumesListTestJSON-128925852 None] Acquiring lock "cinder-quobyte-6943fa32-7abb-44a1-88a2-78f0803b0240" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f6509645-7438-4ff2-972d-858652dace58 tempest-VolumesListTestJSON-128925852 None] Lock "cinder-quobyte-6943fa32-7abb-44a1-88a2-78f0803b0240" acquired by "delete_volume" :: waited 0.029s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:47 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e41f94a-a811-4559-bb0f-4bac1b6718e7]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f6509645-7438-4ff2-972d-858652dace58 tempest-VolumesListTestJSON-128925852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6943fa32-7abb-44a1-88a2-78f0803b0240 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:47 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0866205c-2169-459d-af07-bdbc05d667ba tempest-VolumesListTestJSON-128925852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.398s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:47 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-0866205c-2169-459d-af07-bdbc05d667ba tempest-VolumesListTestJSON-128925852 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:59:47 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-0866205c-2169-459d-af07-bdbc05d667ba tempest-VolumesListTestJSON-128925852 None] Deleted volume successfully. Sep 21 11:59:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0866205c-2169-459d-af07-bdbc05d667ba tempest-VolumesListTestJSON-128925852 None] Lock "cinder-fc685545-a918-4910-9bc9-abd27ae9a818-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:47 devstack sudo[96639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6943fa32-7abb-44a1-88a2-78f0803b0240 Sep 21 11:59:47 devstack sudo[96639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:48 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-8ea74e72-4e38-4145-b7d9-3ef755539ece tempest-GroupsV320Test-1030114939 None] Group tempest-GroupsV320Test-Group-33419133: creating Sep 21 11:59:48 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-8ea74e72-4e38-4145-b7d9-3ef755539ece tempest-GroupsV320Test-1030114939 None] Group tempest-GroupsV320Test-Group-33419133: created successfully Sep 21 11:59:48 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-8ea74e72-4e38-4145-b7d9-3ef755539ece tempest-GroupsV320Test-1030114939 None] Create group completed successfully. Sep 21 11:59:48 devstack sudo[96639]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f6509645-7438-4ff2-972d-858652dace58 tempest-VolumesListTestJSON-128925852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6943fa32-7abb-44a1-88a2-78f0803b0240" returned: 0 in 0.624s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f6509645-7438-4ff2-972d-858652dace58 tempest-VolumesListTestJSON-128925852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6943fa32-7abb-44a1-88a2-78f0803b0240 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:48 devstack sudo[96645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6943fa32-7abb-44a1-88a2-78f0803b0240 Sep 21 11:59:48 devstack sudo[96645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:48 devstack sudo[96645]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f6509645-7438-4ff2-972d-858652dace58 tempest-VolumesListTestJSON-128925852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6943fa32-7abb-44a1-88a2-78f0803b0240" returned: 0 in 0.291s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:48 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f6509645-7438-4ff2-972d-858652dace58 tempest-VolumesListTestJSON-128925852 None] Lock "cinder-quobyte-6943fa32-7abb-44a1-88a2-78f0803b0240" released by "delete_volume" :: held 0.971s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:48 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-f6509645-7438-4ff2-972d-858652dace58 tempest-VolumesListTestJSON-128925852 None] Created reservations ['c1c0bea1-2e05-446f-8b40-d9a73862080e', '5f892c8d-d2e4-4556-b487-22baeca59e9e', 'ae49c868-7447-473e-9965-961e8e7e19b9', 'f5bee022-6153-41df-8714-03cc92536583'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:59:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f6509645-7438-4ff2-972d-858652dace58 tempest-VolumesListTestJSON-128925852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f6509645-7438-4ff2-972d-858652dace58 tempest-VolumesListTestJSON-128925852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:48 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f6509645-7438-4ff2-972d-858652dace58 tempest-VolumesListTestJSON-128925852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:48 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f6509645-7438-4ff2-972d-858652dace58 tempest-VolumesListTestJSON-128925852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f6509645-7438-4ff2-972d-858652dace58 tempest-VolumesListTestJSON-128925852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f6509645-7438-4ff2-972d-858652dace58 tempest-VolumesListTestJSON-128925852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:48 devstack sudo[96683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:59:48 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:49 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f6509645-7438-4ff2-972d-858652dace58 tempest-VolumesListTestJSON-128925852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.357s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:49 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-f6509645-7438-4ff2-972d-858652dace58 tempest-VolumesListTestJSON-128925852 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:59:49 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-f6509645-7438-4ff2-972d-858652dace58 tempest-VolumesListTestJSON-128925852 None] Deleted volume successfully. Sep 21 11:59:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f6509645-7438-4ff2-972d-858652dace58 tempest-VolumesListTestJSON-128925852 None] Lock "cinder-6943fa32-7abb-44a1-88a2-78f0803b0240-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:49 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_xtayvs5xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-97600dc6-b927-4c50-b826-d8c83fb494de" returned: 0 in 2.722s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:49 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_xtayvs5xdevstack@QuobyteHD, size 112.00 MB, duration 2.72 sec, destination /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-97600dc6-b927-4c50-b826-d8c83fb494de {{(pid=86366) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 11:59:49 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Converted 112.00 MB image at 41.13 MB/s Sep 21 11:59:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-97600dc6-b927-4c50-b826-d8c83fb494de 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:49 devstack sudo[96688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-97600dc6-b927-4c50-b826-d8c83fb494de 1G Sep 21 11:59:49 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:49 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-207a7bda-3460-4233-b081-12c70a58e601 tempest-GroupsV320Test-1030114939 None] Created reservations ['84d4b6a9-da90-42b6-a002-a0863331d105'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:59:49 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-cdd9cd62-5d29-40fb-b443-76b3e4958c15 tempest-GroupSnapshotsTest-435114483 None] Group tempest-GroupSnapshotsTest-Group-504680853: creating Sep 21 11:59:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-207a7bda-3460-4233-b081-12c70a58e601 tempest-GroupsV320Test-1030114939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-207a7bda-3460-4233-b081-12c70a58e601 tempest-GroupsV320Test-1030114939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:49 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-207a7bda-3460-4233-b081-12c70a58e601 tempest-GroupsV320Test-1030114939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:49 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-207a7bda-3460-4233-b081-12c70a58e601 tempest-GroupsV320Test-1030114939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-207a7bda-3460-4233-b081-12c70a58e601 tempest-GroupsV320Test-1030114939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-207a7bda-3460-4233-b081-12c70a58e601 tempest-GroupsV320Test-1030114939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:49 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-cdd9cd62-5d29-40fb-b443-76b3e4958c15 tempest-GroupSnapshotsTest-435114483 None] Group tempest-GroupSnapshotsTest-Group-504680853: created successfully Sep 21 11:59:49 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-cdd9cd62-5d29-40fb-b443-76b3e4958c15 tempest-GroupSnapshotsTest-435114483 None] Create group completed successfully. Sep 21 11:59:50 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:59:50 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:50 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-97600dc6-b927-4c50-b826-d8c83fb494de 1G" returned: 0 in 0.468s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:50 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Downloaded image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 ((None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}])) to volume 97600dc6-b927-4c50-b826-d8c83fb494de successfully. {{(pid=86366) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 21 11:59:50 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Temporary image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 for user 3fca0478901b4b5d96fad9ceb2fc57b1 is deleted. {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 21 11:59:50 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Marking volume 97600dc6-b927-4c50-b826-d8c83fb494de as bootable. {{(pid=86366) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 21 11:59:50 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Copying metadata from image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 to 97600dc6-b927-4c50-b826-d8c83fb494de. {{(pid=86366) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 21 11:59:50 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Creating volume glance metadata for volume 97600dc6-b927-4c50-b826-d8c83fb494de backed by image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86366) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 21 11:59:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec5360d-510a-4444-be98-373fe6c43442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97600dc6-b927-4c50-b826-d8c83fb494de', 'volume_size': 1, 'image_id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6c23462c1d34d9a9d8fbc8d8872d421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'created_at': datetime.datetime(2026, 9, 21, 9, 44, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 9, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25341a14-81ea-4df5-a03a-3fec803c0ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:50 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Volume volume-97600dc6-b927-4c50-b826-d8c83fb494de (97600dc6-b927-4c50-b826-d8c83fb494de): created successfully Sep 21 11:59:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25341a14-81ea-4df5-a03a-3fec803c0ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Flow 'volume_create_manager' (b337ceaa-7f8d-41d5-9b58-8c267d857297) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:59:50 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-79262efe-faf3-461d-8a7d-02e4a641c858 tempest-VolumesExtendTest-343891008 None] Created volume successfully. Sep 21 11:59:50 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-207a7bda-3460-4233-b081-12c70a58e601 tempest-GroupsV320Test-1030114939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.417s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:50 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-207a7bda-3460-4233-b081-12c70a58e601 tempest-GroupsV320Test-1030114939 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:59:50 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-207a7bda-3460-4233-b081-12c70a58e601 tempest-GroupsV320Test-1030114939 None] Delete group completed successfully. Sep 21 11:59:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-692e7eed-609b-46cf-ab3c-3651a2a80c8b tempest-VolumesExtendTest-343891008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-692e7eed-609b-46cf-ab3c-3651a2a80c8b tempest-VolumesExtendTest-343891008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:51 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46a52ad-a8cc-4cd3-b7ec-41ef2848a83b]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-692e7eed-609b-46cf-ab3c-3651a2a80c8b tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-97600dc6-b927-4c50-b826-d8c83fb494de {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:51 devstack sudo[96697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-97600dc6-b927-4c50-b826-d8c83fb494de Sep 21 11:59:51 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:51 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:59:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Flow 'volume_create_manager' (6a8f3561-fc87-46f1-96a8-5391c261c850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:59:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b22089b1-f5de-4d96-9d87-7945176d9826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b22089b1-f5de-4d96-9d87-7945176d9826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-519576307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=54afca49-fee4-427e-94a1-23e5a674816a,host='devstack@QuobyteHD#QuobyteHD',id=ed033317-1a23-4ac5-82b4-8ff362dcd8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d775184b136740b78bd9fa4b0e6c376e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:59:52Z,use_quota=True,user_id='7ce00b84d5a2416793336dbaf2dd56b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec4a56a9-f0e9-434a-93e6-90ebb161cce0),volume_type_id=ec4a56a9-f0e9-434a-93e6-90ebb161cce0)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (639c4f69-c1bb-4f70-a26f-36f0a5e3ceb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (639c4f69-c1bb-4f70-a26f-36f0a5e3ceb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae6e315-7a27-4d35-9045-fe258857297a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae6e315-7a27-4d35-9045-fe258857297a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed033317-1a23-4ac5-82b4-8ff362dcd8d4', 'volume_name': 'volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a953b5a-79f9-40e4-b800-f265d640651a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a953b5a-79f9-40e4-b800-f265d640651a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afba1be3-ddc8-4689-9fcb-f1b4f97fc987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:52 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Volume ed033317-1a23-4ac5-82b4-8ff362dcd8d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4', 'volume_size': 1} Sep 21 11:59:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:52 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-692e7eed-609b-46cf-ab3c-3651a2a80c8b tempest-VolumesExtendTest-343891008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-97600dc6-b927-4c50-b826-d8c83fb494de" returned: 0 in 0.708s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-692e7eed-609b-46cf-ab3c-3651a2a80c8b tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-97600dc6-b927-4c50-b826-d8c83fb494de 2G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-692e7eed-609b-46cf-ab3c-3651a2a80c8b tempest-VolumesExtendTest-343891008 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-97600dc6-b927-4c50-b826-d8c83fb494de 2G" returned: 0 in 0.146s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-692e7eed-609b-46cf-ab3c-3651a2a80c8b tempest-VolumesExtendTest-343891008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.917s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.317s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=54afca49-fee4-427e-94a1-23e5a674816a,created_at=2026-09-21T09:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-519576307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=54afca49-fee4-427e-94a1-23e5a674816a,host='devstack@QuobyteHD#QuobyteHD',id=ed033317-1a23-4ac5-82b4-8ff362dcd8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d775184b136740b78bd9fa4b0e6c376e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:59:52Z,use_quota=True,user_id='7ce00b84d5a2416793336dbaf2dd56b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec4a56a9-f0e9-434a-93e6-90ebb161cce0),volume_type_id=ec4a56a9-f0e9-434a-93e6-90ebb161cce0)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:59:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Creating volume ed033317-1a23-4ac5-82b4-8ff362dcd8d4 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:59:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:59:52 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:59:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:52 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4 1073741824 Sep 21 11:59:52 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:52 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-692e7eed-609b-46cf-ab3c-3651a2a80c8b tempest-VolumesExtendTest-343891008 None] Extend volume completed successfully. Sep 21 11:59:53 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4 1073741824" returned: 0 in 0.757s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:53 devstack sudo[96713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4 Sep 21 11:59:53 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-62b6151d-f4a0-4942-90f8-b3596363d50e tempest-VolumesExtendTest-343891008 None] Acquiring lock "cinder-97600dc6-b927-4c50-b826-d8c83fb494de-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-62b6151d-f4a0-4942-90f8-b3596363d50e tempest-VolumesExtendTest-343891008 None] Lock "cinder-97600dc6-b927-4c50-b826-d8c83fb494de-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-62b6151d-f4a0-4942-90f8-b3596363d50e tempest-VolumesExtendTest-343891008 None] Acquiring lock "cinder-quobyte-97600dc6-b927-4c50-b826-d8c83fb494de" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-62b6151d-f4a0-4942-90f8-b3596363d50e tempest-VolumesExtendTest-343891008 None] Lock "cinder-quobyte-97600dc6-b927-4c50-b826-d8c83fb494de" acquired by "delete_volume" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:53 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a1bda0-1e45-48d7-a49f-736b00692d46]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-62b6151d-f4a0-4942-90f8-b3596363d50e tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-97600dc6-b927-4c50-b826-d8c83fb494de {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:53 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:53 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-97600dc6-b927-4c50-b826-d8c83fb494de Sep 21 11:59:53 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4" returned: 0 in 0.447s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:53 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:59:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:53 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afba1be3-ddc8-4689-9fcb-f1b4f97fc987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:53 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0e547a-dc6a-4cf0-a287-958485f25afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:53 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Volume volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4 (ed033317-1a23-4ac5-82b4-8ff362dcd8d4): created successfully Sep 21 11:59:53 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0e547a-dc6a-4cf0-a287-958485f25afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:53 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Flow 'volume_create_manager' (6a8f3561-fc87-46f1-96a8-5391c261c850) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:59:53 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-c4870e5a-3965-4068-b803-5a10dfc54762 tempest-GroupSnapshotsTest-435114483 None] Created volume successfully. Sep 21 11:59:54 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-62b6151d-f4a0-4942-90f8-b3596363d50e tempest-VolumesExtendTest-343891008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-97600dc6-b927-4c50-b826-d8c83fb494de" returned: 0 in 0.610s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-62b6151d-f4a0-4942-90f8-b3596363d50e tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-97600dc6-b927-4c50-b826-d8c83fb494de {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:54 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-97600dc6-b927-4c50-b826-d8c83fb494de Sep 21 11:59:54 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:54 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-62b6151d-f4a0-4942-90f8-b3596363d50e tempest-VolumesExtendTest-343891008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-97600dc6-b927-4c50-b826-d8c83fb494de" returned: 0 in 0.475s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-62b6151d-f4a0-4942-90f8-b3596363d50e tempest-VolumesExtendTest-343891008 None] Lock "cinder-quobyte-97600dc6-b927-4c50-b826-d8c83fb494de" released by "delete_volume" :: held 1.172s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:54 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-62b6151d-f4a0-4942-90f8-b3596363d50e tempest-VolumesExtendTest-343891008 None] Created reservations ['49bb9148-cbfe-4c90-adec-fbc617efd82f', '15ea40dd-dfc3-4cf9-89f1-d8ab52a233aa', '1a1e8bde-edfb-413e-97ab-6aa5697379fe', 'dc544011-129f-4fbe-877a-4b795542bbdb'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 11:59:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-62b6151d-f4a0-4942-90f8-b3596363d50e tempest-VolumesExtendTest-343891008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-62b6151d-f4a0-4942-90f8-b3596363d50e tempest-VolumesExtendTest-343891008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:55 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-62b6151d-f4a0-4942-90f8-b3596363d50e tempest-VolumesExtendTest-343891008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:55 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-62b6151d-f4a0-4942-90f8-b3596363d50e tempest-VolumesExtendTest-343891008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-62b6151d-f4a0-4942-90f8-b3596363d50e tempest-VolumesExtendTest-343891008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-62b6151d-f4a0-4942-90f8-b3596363d50e tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:55 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 11:59:55 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:55 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-58727162-bc34-4f24-9d67-13c285c83b99 tempest-GroupSnapshotsTest-435114483 None] GroupSnapshot e33cdee3-e746-488f-9dc3-b2c242acffb6: creating. Sep 21 11:59:55 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-58727162-bc34-4f24-9d67-13c285c83b99 tempest-GroupSnapshotsTest-435114483 None] Group snapshot e33cdee3-e746-488f-9dc3-b2c242acffb6: creating. {{(pid=86366) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 21 11:59:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-58727162-bc34-4f24-9d67-13c285c83b99 tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-58727162-bc34-4f24-9d67-13c285c83b99 tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:55 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-58727162-bc34-4f24-9d67-13c285c83b99 tempest-GroupSnapshotsTest-435114483 None] Creating offline snapshot 35ba85ba-11fb-404d-858c-5edd35183f22 of volume ed033317-1a23-4ac5-82b4-8ff362dcd8d4 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 11:59:55 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bbef3f-4c98-48d0-8c5e-4d1015ae0c6e]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-58727162-bc34-4f24-9d67-13c285c83b99 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:55 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4 Sep 21 11:59:55 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:55 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-62b6151d-f4a0-4942-90f8-b3596363d50e tempest-VolumesExtendTest-343891008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.424s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:55 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-62b6151d-f4a0-4942-90f8-b3596363d50e tempest-VolumesExtendTest-343891008 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 11:59:55 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-62b6151d-f4a0-4942-90f8-b3596363d50e tempest-VolumesExtendTest-343891008 None] Deleted volume successfully. Sep 21 11:59:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-62b6151d-f4a0-4942-90f8-b3596363d50e tempest-VolumesExtendTest-343891008 None] Lock "cinder-97600dc6-b927-4c50-b826-d8c83fb494de-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 11:59:55 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-58727162-bc34-4f24-9d67-13c285c83b99 tempest-GroupSnapshotsTest-435114483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4" returned: 0 in 0.549s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-58727162-bc34-4f24-9d67-13c285c83b99 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.35ba85ba-11fb-404d-858c-5edd35183f22 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:55 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.35ba85ba-11fb-404d-858c-5edd35183f22 1G Sep 21 11:59:55 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:56 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-58727162-bc34-4f24-9d67-13c285c83b99 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.35ba85ba-11fb-404d-858c-5edd35183f22 1G" returned: 0 in 0.791s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-58727162-bc34-4f24-9d67-13c285c83b99 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.35ba85ba-11fb-404d-858c-5edd35183f22 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:56 devstack sudo[96740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.35ba85ba-11fb-404d-858c-5edd35183f22 Sep 21 11:59:56 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:56 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 11:59:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Flow 'volume_create_manager' (4926e328-0f34-43e9-8a81-d4d2d3fa9f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:59:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (258db008-ee4b-473b-8eff-bb3b485a26c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (258db008-ee4b-473b-8eff-bb3b485a26c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-967348334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a254b52-d6fa-4f45-a3fa-d22c1de6b094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c2f87b3686423482492bb45ce67b17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:59:57Z,use_quota=True,user_id='3fca0478901b4b5d96fad9ceb2fc57b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa186c22-45a7-4f0a-a2b9-94bdf4888b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa186c22-45a7-4f0a-a2b9-94bdf4888b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f16fd67-a96c-4847-98ad-1d81eacb1e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f16fd67-a96c-4847-98ad-1d81eacb1e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a254b52-d6fa-4f45-a3fa-d22c1de6b094', 'volume_name': 'volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cfc76dd-bd40-4f1b-a27d-c9c85b0ca56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cfc76dd-bd40-4f1b-a27d-c9c85b0ca56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b20f64-6734-4511-9341-cc461cb34d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:56 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Volume 9a254b52-d6fa-4f45-a3fa-d22c1de6b094: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094', 'volume_size': 1} Sep 21 11:59:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:56 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-58727162-bc34-4f24-9d67-13c285c83b99 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.35ba85ba-11fb-404d-858c-5edd35183f22" returned: 0 in 0.393s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:56 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-58727162-bc34-4f24-9d67-13c285c83b99 tempest-GroupSnapshotsTest-435114483 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.35ba85ba-11fb-404d-858c-5edd35183f22 is being set with open permissions: ugo+rw: NotImplementedError Sep 21 11:59:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-58727162-bc34-4f24-9d67-13c285c83b99 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.35ba85ba-11fb-404d-858c-5edd35183f22 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:57 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.35ba85ba-11fb-404d-858c-5edd35183f22 Sep 21 11:59:57 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:57 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-58727162-bc34-4f24-9d67-13c285c83b99 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.35ba85ba-11fb-404d-858c-5edd35183f22" returned: 0 in 0.333s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-58727162-bc34-4f24-9d67-13c285c83b99 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:57 devstack sudo[96749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.info Sep 21 11:59:57 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:57 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-58727162-bc34-4f24-9d67-13c285c83b99 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.info" returned: 0 in 0.334s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:57 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-58727162-bc34-4f24-9d67-13c285c83b99 tempest-GroupSnapshotsTest-435114483 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.info is being set with open permissions: ugo+rw: NotImplementedError Sep 21 11:59:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-58727162-bc34-4f24-9d67-13c285c83b99 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:57 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.info Sep 21 11:59:57 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:58 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-58727162-bc34-4f24-9d67-13c285c83b99 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.info" returned: 0 in 0.341s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-58727162-bc34-4f24-9d67-13c285c83b99 tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.911s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.278s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T09:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-967348334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a254b52-d6fa-4f45-a3fa-d22c1de6b094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c2f87b3686423482492bb45ce67b17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T09:59:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T09:59:57Z,use_quota=True,user_id='3fca0478901b4b5d96fad9ceb2fc57b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 11:59:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Creating volume 9a254b52-d6fa-4f45-a3fa-d22c1de6b094 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 11:59:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:59:58 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 11:59:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:58 devstack sudo[96755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094 1073741824 Sep 21 11:59:58 devstack sudo[96755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:58 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-58727162-bc34-4f24-9d67-13c285c83b99 tempest-GroupSnapshotsTest-435114483 None] group_snapshot e33cdee3-e746-488f-9dc3-b2c242acffb6: created successfully Sep 21 11:59:58 devstack sudo[96755]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094 1073741824" returned: 0 in 0.672s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:58 devstack sudo[96762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094 Sep 21 11:59:58 devstack sudo[96762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 11:59:59 devstack sudo[96762]: pam_unix(sudo:session): session closed for user root Sep 21 11:59:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094" returned: 0 in 0.335s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 11:59:59 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 11:59:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b20f64-6734-4511-9341-cc461cb34d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bb44e2-3e19-47b4-9f31-6d1b278a38dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 11:59:59 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Volume volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094 (9a254b52-d6fa-4f45-a3fa-d22c1de6b094): created successfully Sep 21 11:59:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bb44e2-3e19-47b4-9f31-6d1b278a38dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 11:59:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Flow 'volume_create_manager' (4926e328-0f34-43e9-8a81-d4d2d3fa9f6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 11:59:59 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-852ccda6-e9dc-456c-9baf-8a7e95df3c91 tempest-VolumesExtendTest-343891008 None] Created volume successfully. Sep 21 11:59:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "cinder-quobyte-35ba85ba-11fb-404d-858c-5edd35183f22-69951672-83a9-4485-8f94-273ae37e66c4" by "_create_volume_from_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-35ba85ba-11fb-404d-858c-5edd35183f22-69951672-83a9-4485-8f94-273ae37e66c4" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:59 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Creating volume 69951672-83a9-4485-8f94-273ae37e66c4 from snapshot 35ba85ba-11fb-404d-858c-5edd35183f22 {{(pid=86366) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 21 11:59:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:59 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:59 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:59 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 11:59:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "cinder-quobyte-69951672-83a9-4485-8f94-273ae37e66c4" by "_copy_volume_from_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 11:59:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-69951672-83a9-4485-8f94-273ae37e66c4" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 11:59:59 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] snapshot: 35ba85ba-11fb-404d-858c-5edd35183f22, volume: 69951672-83a9-4485-8f94-273ae37e66c4, {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 21 11:59:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 11:59:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 11:59:59 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 11:59:59 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 11:59:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 11:59:59 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3ecbed-e147-4011-bcaf-b72f7cecd3db]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 11:59:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.35ba85ba-11fb-404d-858c-5edd35183f22 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 11:59:59 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.35ba85ba-11fb-404d-858c-5edd35183f22 Sep 21 11:59:59 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:00 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:00:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Flow 'volume_create_manager' (33a56957-4ed4-47ae-9bd5-d1a30d6c7f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:00:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5e9c09-e8a3-4764-bc9d-34233de2cccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5e9c09-e8a3-4764-bc9d-34233de2cccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-584407175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b9f506f-6ddd-485e-bdea-f3f42a527175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8ece74e2a4b4750b9b72ecf83235c76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:00:00Z,use_quota=True,user_id='25837f9d3bf140d690c346da969ed0aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d67d6e1-f9b9-4a5d-a5e4-8869697bd5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d67d6e1-f9b9-4a5d-a5e4-8869697bd5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073c8f62-8203-43b0-89f6-f4a838cb77b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073c8f62-8203-43b0-89f6-f4a838cb77b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b9f506f-6ddd-485e-bdea-f3f42a527175', 'volume_name': 'volume-5b9f506f-6ddd-485e-bdea-f3f42a527175', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54362b5e-23bd-44cf-ba1f-c0395d06c2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54362b5e-23bd-44cf-ba1f-c0395d06c2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9695a7a4-6cf8-4ae7-9c98-bf3778125302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:00 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Volume 5b9f506f-6ddd-485e-bdea-f3f42a527175: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b9f506f-6ddd-485e-bdea-f3f42a527175', 'volume_size': 1} Sep 21 12:00:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:00 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.35ba85ba-11fb-404d-858c-5edd35183f22" returned: 0 in 0.771s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:00:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-980038d7-4038-4dd8-8465-938c70be7772 tempest-VolumesExtendTest-343891008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:00 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32e96f9-8909-409a-adbb-6d3f4da91d34]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:00 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4 Sep 21 12:00:00 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:00 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4" returned: 0 in 0.415s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4 {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 21 12:00:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Creating direct copy from snapshot {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 21 12:00:00 devstack cinder-volume[86366]: DEBUG cinder.utils [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Path /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-69951672-83a9-4485-8f94-273ae37e66c4 not found in is_blk_device check {{(pid=86366) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 21 12:00:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-69951672-83a9-4485-8f94-273ae37e66c4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:00 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-69951672-83a9-4485-8f94-273ae37e66c4 Sep 21 12:00:00 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:03 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 12:00:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:00:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:00:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:03 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:00:03 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:04 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.691s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:04 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:00:04 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 12:00:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread count: 28 {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 12:00:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread info: [<_MainThread(MainThread, started 132841976594560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 12:00:09 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-69951672-83a9-4485-8f94-273ae37e66c4" returned: 0 in 8.506s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:09 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Image conversion details: src /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4, size 1024.00 MB, duration 8.51 sec, destination /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-69951672-83a9-4485-8f94-273ae37e66c4 {{(pid=86366) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 12:00:09 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Converted 1024.00 MB image at 120.37 MB/s Sep 21 12:00:09 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-69951672-83a9-4485-8f94-273ae37e66c4 is being set with open permissions: ugo+rw: NotImplementedError Sep 21 12:00:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-69951672-83a9-4485-8f94-273ae37e66c4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:09 devstack sudo[96801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-69951672-83a9-4485-8f94-273ae37e66c4 Sep 21 12:00:09 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:09 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-69951672-83a9-4485-8f94-273ae37e66c4" returned: 0 in 0.257s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-69951672-83a9-4485-8f94-273ae37e66c4" released by "_copy_volume_from_snapshot" :: held 10.096s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-35ba85ba-11fb-404d-858c-5edd35183f22-69951672-83a9-4485-8f94-273ae37e66c4" released by "_create_volume_from_snapshot" :: held 10.180s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.211s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.325s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-584407175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b9f506f-6ddd-485e-bdea-f3f42a527175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8ece74e2a4b4750b9b72ecf83235c76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:00:00Z,use_quota=True,user_id='25837f9d3bf140d690c346da969ed0aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:00:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Creating volume 5b9f506f-6ddd-485e-bdea-f3f42a527175 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:00:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:00:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:00:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:00:09 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:00:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:09 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175 1073741824 Sep 21 12:00:09 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:09 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-f31bb02c-6d52-4cce-93ce-5f4a2934870b tempest-GroupSnapshotsTest-435114483 None] Create group from source-snapshot-e33cdee3-e746-488f-9dc3-b2c242acffb6 completed successfully. Sep 21 12:00:10 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175 1073741824" returned: 0 in 0.483s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:10 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175 Sep 21 12:00:10 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:10 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175" returned: 0 in 0.314s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:10 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:00:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-980038d7-4038-4dd8-8465-938c70be7772 tempest-VolumesExtendTest-343891008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.098s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:10 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-980038d7-4038-4dd8-8465-938c70be7772 tempest-VolumesExtendTest-343891008 None] Creating offline snapshot 24d247e8-a96f-4f90-a622-95e8caefb1a6 of volume 9a254b52-d6fa-4f45-a3fa-d22c1de6b094 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:00:10 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9695a7a4-6cf8-4ae7-9c98-bf3778125302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b9f506f-6ddd-485e-bdea-f3f42a527175', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:10 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c03501e-c51a-4f4b-843a-ef52238055f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:10 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb22661-eb7b-445b-a0ab-0137e3275c9f]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-980038d7-4038-4dd8-8465-938c70be7772 tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:10 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Volume volume-5b9f506f-6ddd-485e-bdea-f3f42a527175 (5b9f506f-6ddd-485e-bdea-f3f42a527175): created successfully Sep 21 12:00:10 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c03501e-c51a-4f4b-843a-ef52238055f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:10 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Flow 'volume_create_manager' (33a56957-4ed4-47ae-9bd5-d1a30d6c7f56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:00:10 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-30eb49cf-fbbf-4c97-b87d-3d14d41992f3 tempest-SnapshotsActionsTest-1930914051 None] Created volume successfully. Sep 21 12:00:10 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:00:10 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Flow 'volume_create_manager' (ef70a3f8-2457-41cc-9690-365d0c5d7032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:00:10 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dae7dfe-3612-40a0-9266-7ed1c1914500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:10 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dae7dfe-3612-40a0-9266-7ed1c1914500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-106523508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17db2cf7-88ca-4cd0-a7dc-bc2862271994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b1164abba474a0283c76823e39bcc98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:00:11Z,use_quota=True,user_id='dca8aea142684429b349a15ce64100c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:10 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b6aec0-bea5-4255-8ae7-a0782bad8962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:10 devstack sudo[96815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094 Sep 21 12:00:10 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:10 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b6aec0-bea5-4255-8ae7-a0782bad8962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:10 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (313f1769-0c91-4784-9a31-68b482549a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:10 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (313f1769-0c91-4784-9a31-68b482549a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17db2cf7-88ca-4cd0-a7dc-bc2862271994', 'volume_name': 'volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:10 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ad1ca0-25e2-4573-8156-1f3965f7508c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:10 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ad1ca0-25e2-4573-8156-1f3965f7508c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:10 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b30d71-41c1-44bd-9b02-9c1ba7140943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:10 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Volume 17db2cf7-88ca-4cd0-a7dc-bc2862271994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994', 'volume_size': 1} Sep 21 12:00:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:10 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-980038d7-4038-4dd8-8465-938c70be7772 tempest-VolumesExtendTest-343891008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094" returned: 0 in 0.416s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-980038d7-4038-4dd8-8465-938c70be7772 tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.24d247e8-a96f-4f90-a622-95e8caefb1a6 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:10 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.24d247e8-a96f-4f90-a622-95e8caefb1a6 1G Sep 21 12:00:10 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f33fa522-0d7f-4942-82bb-89c0ffe5d1af tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "cinder-quobyte-69951672-83a9-4485-8f94-273ae37e66c4" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f33fa522-0d7f-4942-82bb-89c0ffe5d1af tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-69951672-83a9-4485-8f94-273ae37e66c4" acquired by "delete_volume" :: waited 0.018s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:11 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd759e4d-9d89-4cf0-9959-8f41a029d0cb]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f33fa522-0d7f-4942-82bb-89c0ffe5d1af tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-69951672-83a9-4485-8f94-273ae37e66c4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:11 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-69951672-83a9-4485-8f94-273ae37e66c4 Sep 21 12:00:11 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:11 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-980038d7-4038-4dd8-8465-938c70be7772 tempest-VolumesExtendTest-343891008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.24d247e8-a96f-4f90-a622-95e8caefb1a6 1G" returned: 0 in 0.492s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-980038d7-4038-4dd8-8465-938c70be7772 tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.24d247e8-a96f-4f90-a622-95e8caefb1a6 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:11 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.24d247e8-a96f-4f90-a622-95e8caefb1a6 Sep 21 12:00:11 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b7eedf71-3be4-4ab9-86e7-64d7b0f74dc3 tempest-SnapshotsActionsTest-1930914051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:11 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f33fa522-0d7f-4942-82bb-89c0ffe5d1af tempest-GroupSnapshotsTest-435114483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-69951672-83a9-4485-8f94-273ae37e66c4" returned: 0 in 0.496s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f33fa522-0d7f-4942-82bb-89c0ffe5d1af tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-69951672-83a9-4485-8f94-273ae37e66c4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:11 devstack sudo[96832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-69951672-83a9-4485-8f94-273ae37e66c4 Sep 21 12:00:11 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:11 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-980038d7-4038-4dd8-8465-938c70be7772 tempest-VolumesExtendTest-343891008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.24d247e8-a96f-4f90-a622-95e8caefb1a6" returned: 0 in 0.331s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:11 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-980038d7-4038-4dd8-8465-938c70be7772 tempest-VolumesExtendTest-343891008 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.24d247e8-a96f-4f90-a622-95e8caefb1a6 is being set with open permissions: ugo+rw Sep 21 12:00:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-980038d7-4038-4dd8-8465-938c70be7772 tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.24d247e8-a96f-4f90-a622-95e8caefb1a6 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:11 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.24d247e8-a96f-4f90-a622-95e8caefb1a6 Sep 21 12:00:11 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:11 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f33fa522-0d7f-4942-82bb-89c0ffe5d1af tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-69951672-83a9-4485-8f94-273ae37e66c4" returned: 0 in 0.278s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f33fa522-0d7f-4942-82bb-89c0ffe5d1af tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-69951672-83a9-4485-8f94-273ae37e66c4" released by "delete_volume" :: held 0.826s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:11 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-f33fa522-0d7f-4942-82bb-89c0ffe5d1af tempest-GroupSnapshotsTest-435114483 None] Created reservations ['aee0b050-43b7-4c83-86fc-6667b6eda2cf'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:00:11 devstack cinder-volume[86366]: WARNING cinder.quota [None req-f33fa522-0d7f-4942-82bb-89c0ffe5d1af tempest-GroupSnapshotsTest-435114483 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-228835747 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-228835747, it is now deprecated. Please use the default quota class for default quota. Sep 21 12:00:11 devstack cinder-volume[86366]: WARNING cinder.quota [None req-f33fa522-0d7f-4942-82bb-89c0ffe5d1af tempest-GroupSnapshotsTest-435114483 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-228835747 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-228835747, it is now deprecated. Please use the default quota class for default quota. Sep 21 12:00:11 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-f33fa522-0d7f-4942-82bb-89c0ffe5d1af tempest-GroupSnapshotsTest-435114483 None] Created reservations ['7dec7c4d-7189-4315-a864-783dd04c0706', 'fa5423e2-be23-459e-bc8f-c76ad3c329db', '986c572c-9f4f-4300-8cb0-66158c6329cc', '9411b530-1a22-4882-8585-d204afba0dfe'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:00:12 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-980038d7-4038-4dd8-8465-938c70be7772 tempest-VolumesExtendTest-343891008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.24d247e8-a96f-4f90-a622-95e8caefb1a6" returned: 0 in 0.284s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f33fa522-0d7f-4942-82bb-89c0ffe5d1af tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f33fa522-0d7f-4942-82bb-89c0ffe5d1af tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f33fa522-0d7f-4942-82bb-89c0ffe5d1af tempest-GroupSnapshotsTest-435114483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f33fa522-0d7f-4942-82bb-89c0ffe5d1af tempest-GroupSnapshotsTest-435114483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f33fa522-0d7f-4942-82bb-89c0ffe5d1af tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f33fa522-0d7f-4942-82bb-89c0ffe5d1af tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-980038d7-4038-4dd8-8465-938c70be7772 tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:12 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:00:12 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:12 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.info Sep 21 12:00:12 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:12 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-48d2d4c2-496b-4f54-b323-880f34dd40a2 tempest-GroupSnapshotsTest-435114483 None] group_snapshot e33cdee3-e746-488f-9dc3-b2c242acffb6: deleting Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-48d2d4c2-496b-4f54-b323-880f34dd40a2 tempest-GroupSnapshotsTest-435114483 None] group_snapshot e33cdee3-e746-488f-9dc3-b2c242acffb6: deleting {{(pid=86366) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-48d2d4c2-496b-4f54-b323-880f34dd40a2 tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "cinder-quobyte-ed033317-1a23-4ac5-82b4-8ff362dcd8d4" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-48d2d4c2-496b-4f54-b323-880f34dd40a2 tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-ed033317-1a23-4ac5-82b4-8ff362dcd8d4" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-48d2d4c2-496b-4f54-b323-880f34dd40a2 tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "cinder-quobyte-35ba85ba-11fb-404d-858c-5edd35183f22" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-48d2d4c2-496b-4f54-b323-880f34dd40a2 tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-35ba85ba-11fb-404d-858c-5edd35183f22" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-48d2d4c2-496b-4f54-b323-880f34dd40a2 tempest-GroupSnapshotsTest-435114483 None] Deleting offline snapshot 35ba85ba-11fb-404d-858c-5edd35183f22 of volume ed033317-1a23-4ac5-82b4-8ff362dcd8d4 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:00:12 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:12 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-48d2d4c2-496b-4f54-b323-880f34dd40a2 tempest-GroupSnapshotsTest-435114483 None] snapshot_file for this snap is: volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.35ba85ba-11fb-404d-858c-5edd35183f22 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f33fa522-0d7f-4942-82bb-89c0ffe5d1af tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.351s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-980038d7-4038-4dd8-8465-938c70be7772 tempest-VolumesExtendTest-343891008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.info" returned: 0 in 0.335s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-f33fa522-0d7f-4942-82bb-89c0ffe5d1af tempest-GroupSnapshotsTest-435114483 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:00:12 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-980038d7-4038-4dd8-8465-938c70be7772 tempest-VolumesExtendTest-343891008 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.info is being set with open permissions: ugo+rw Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-980038d7-4038-4dd8-8465-938c70be7772 tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[949aeaab-6b3e-43cf-8be7-1a68c6814fbe]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-48d2d4c2-496b-4f54-b323-880f34dd40a2 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.35ba85ba-11fb-404d-858c-5edd35183f22 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:12 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.info Sep 21 12:00:12 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-f33fa522-0d7f-4942-82bb-89c0ffe5d1af tempest-GroupSnapshotsTest-435114483 None] Delete group completed successfully. Sep 21 12:00:12 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:12 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.35ba85ba-11fb-404d-858c-5edd35183f22 Sep 21 12:00:12 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:12 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-980038d7-4038-4dd8-8465-938c70be7772 tempest-VolumesExtendTest-343891008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.info" returned: 0 in 0.281s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-980038d7-4038-4dd8-8465-938c70be7772 tempest-VolumesExtendTest-343891008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.268s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.060s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-106523508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17db2cf7-88ca-4cd0-a7dc-bc2862271994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b1164abba474a0283c76823e39bcc98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:00:11Z,use_quota=True,user_id='dca8aea142684429b349a15ce64100c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Creating volume 17db2cf7-88ca-4cd0-a7dc-bc2862271994 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:00:12 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:12 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994 1073741824 Sep 21 12:00:12 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:12 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-980038d7-4038-4dd8-8465-938c70be7772 tempest-VolumesExtendTest-343891008 None] Create snapshot completed successfully Sep 21 12:00:12 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-48d2d4c2-496b-4f54-b323-880f34dd40a2 tempest-GroupSnapshotsTest-435114483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.35ba85ba-11fb-404d-858c-5edd35183f22" returned: 0 in 0.446s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-48d2d4c2-496b-4f54-b323-880f34dd40a2 tempest-GroupSnapshotsTest-435114483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[061ebbbe-0397-4d8f-8370-7947f69c7566]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-48d2d4c2-496b-4f54-b323-880f34dd40a2 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:13 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4 Sep 21 12:00:13 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7b0934c6-6246-4023-b132-4c13bc3a40c1 tempest-VolumesExtendTest-343891008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:13 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994 1073741824" returned: 0 in 0.585s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:13 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994 Sep 21 12:00:13 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:13 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-48d2d4c2-496b-4f54-b323-880f34dd40a2 tempest-GroupSnapshotsTest-435114483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4" returned: 0 in 0.682s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-48d2d4c2-496b-4f54-b323-880f34dd40a2 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.35ba85ba-11fb-404d-858c-5edd35183f22 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:13 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.35ba85ba-11fb-404d-858c-5edd35183f22 Sep 21 12:00:13 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:13 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994" returned: 0 in 0.276s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:13 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:00:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b7eedf71-3be4-4ab9-86e7-64d7b0f74dc3 tempest-SnapshotsActionsTest-1930914051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.150s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:13 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-b7eedf71-3be4-4ab9-86e7-64d7b0f74dc3 tempest-SnapshotsActionsTest-1930914051 None] Creating offline snapshot 7cf9af08-c330-4e55-b5f6-c24ef96748ac of volume 5b9f506f-6ddd-485e-bdea-f3f42a527175 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:00:13 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b30d71-41c1-44bd-9b02-9c1ba7140943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:13 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84b1ad7d-23ad-4980-9248-9e1443700d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:13 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[6704c8cc-864a-41d5-a422-b656ce5b5c58]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b7eedf71-3be4-4ab9-86e7-64d7b0f74dc3 tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:13 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Volume volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994 (17db2cf7-88ca-4cd0-a7dc-bc2862271994): created successfully Sep 21 12:00:13 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84b1ad7d-23ad-4980-9248-9e1443700d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:13 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Flow 'volume_create_manager' (ef70a3f8-2457-41cc-9690-365d0c5d7032) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:00:13 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-2c5431f6-8691-41b2-ae9b-265ec6c34572 tempest-VolumesSnapshotTestJSON-402880464 None] Created volume successfully. Sep 21 12:00:13 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175 Sep 21 12:00:13 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:14 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-48d2d4c2-496b-4f54-b323-880f34dd40a2 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.35ba85ba-11fb-404d-858c-5edd35183f22" returned: 0 in 0.363s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-48d2d4c2-496b-4f54-b323-880f34dd40a2 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.35ba85ba-11fb-404d-858c-5edd35183f22 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:14 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.35ba85ba-11fb-404d-858c-5edd35183f22 Sep 21 12:00:14 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:14 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b7eedf71-3be4-4ab9-86e7-64d7b0f74dc3 tempest-SnapshotsActionsTest-1930914051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175" returned: 0 in 0.416s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b7eedf71-3be4-4ab9-86e7-64d7b0f74dc3 tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:14 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac 1G Sep 21 12:00:14 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:14 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-48d2d4c2-496b-4f54-b323-880f34dd40a2 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4.35ba85ba-11fb-404d-858c-5edd35183f22" returned: 0 in 0.276s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-48d2d4c2-496b-4f54-b323-880f34dd40a2 tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-35ba85ba-11fb-404d-858c-5edd35183f22" released by "_delete_snapshot" :: held 1.911s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-48d2d4c2-496b-4f54-b323-880f34dd40a2 tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-ed033317-1a23-4ac5-82b4-8ff362dcd8d4" released by "delete_snapshot" :: held 1.942s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:14 devstack cinder-volume[86366]: WARNING cinder.quota [None req-48d2d4c2-496b-4f54-b323-880f34dd40a2 tempest-GroupSnapshotsTest-435114483 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-228835747 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-228835747, it is now deprecated. Please use the default quota class for default quota. Sep 21 12:00:14 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-48d2d4c2-496b-4f54-b323-880f34dd40a2 tempest-GroupSnapshotsTest-435114483 None] Created reservations ['4fd39b2a-ebe4-404a-8332-a8897c198418', '9f2fb18f-ef6d-493b-9319-778c84c2bb68', '8d623a41-045b-47b7-93e4-5e36b8ffd470', 'bbceb078-c0a9-4481-9bce-7747ddf0d4b1'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:00:14 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-48d2d4c2-496b-4f54-b323-880f34dd40a2 tempest-GroupSnapshotsTest-435114483 None] group_snapshot e33cdee3-e746-488f-9dc3-b2c242acffb6: deleted successfully Sep 21 12:00:14 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b7eedf71-3be4-4ab9-86e7-64d7b0f74dc3 tempest-SnapshotsActionsTest-1930914051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac 1G" returned: 0 in 0.474s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b7eedf71-3be4-4ab9-86e7-64d7b0f74dc3 tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b9f506f-6ddd-485e-bdea-f3f42a527175 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:14 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b9f506f-6ddd-485e-bdea-f3f42a527175 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac Sep 21 12:00:14 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:14 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b7eedf71-3be4-4ab9-86e7-64d7b0f74dc3 tempest-SnapshotsActionsTest-1930914051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b9f506f-6ddd-485e-bdea-f3f42a527175 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac" returned: 0 in 0.365s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:14 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-b7eedf71-3be4-4ab9-86e7-64d7b0f74dc3 tempest-SnapshotsActionsTest-1930914051 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac is being set with open permissions: ugo+rw Sep 21 12:00:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b7eedf71-3be4-4ab9-86e7-64d7b0f74dc3 tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1310f9f4-165d-4a9a-8341-2b335ea9c78f tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "cinder-quobyte-ed033317-1a23-4ac5-82b4-8ff362dcd8d4" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:15 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac Sep 21 12:00:15 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:15 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1310f9f4-165d-4a9a-8341-2b335ea9c78f tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-ed033317-1a23-4ac5-82b4-8ff362dcd8d4" acquired by "delete_volume" :: waited 0.033s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:15 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c471e6-16c6-49a1-b485-e5bc4583d1c8]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1310f9f4-165d-4a9a-8341-2b335ea9c78f tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2f9c3870-4514-43b7-9e3b-6b4ad8f80bc2 tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:15 devstack sudo[96895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4 Sep 21 12:00:15 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:15 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b7eedf71-3be4-4ab9-86e7-64d7b0f74dc3 tempest-SnapshotsActionsTest-1930914051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac" returned: 0 in 0.343s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b7eedf71-3be4-4ab9-86e7-64d7b0f74dc3 tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:15 devstack sudo[96898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.info Sep 21 12:00:15 devstack sudo[96898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:15 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1310f9f4-165d-4a9a-8341-2b335ea9c78f tempest-GroupSnapshotsTest-435114483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4" returned: 0 in 0.436s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1310f9f4-165d-4a9a-8341-2b335ea9c78f tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:15 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4 Sep 21 12:00:15 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:15 devstack sudo[96898]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b7eedf71-3be4-4ab9-86e7-64d7b0f74dc3 tempest-SnapshotsActionsTest-1930914051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.info" returned: 0 in 0.278s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:15 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-b7eedf71-3be4-4ab9-86e7-64d7b0f74dc3 tempest-SnapshotsActionsTest-1930914051 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.info is being set with open permissions: ugo+rw Sep 21 12:00:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b7eedf71-3be4-4ab9-86e7-64d7b0f74dc3 tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:15 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.info Sep 21 12:00:15 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:15 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1310f9f4-165d-4a9a-8341-2b335ea9c78f tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ed033317-1a23-4ac5-82b4-8ff362dcd8d4" returned: 0 in 0.259s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:15 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1310f9f4-165d-4a9a-8341-2b335ea9c78f tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-ed033317-1a23-4ac5-82b4-8ff362dcd8d4" released by "delete_volume" :: held 0.802s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:15 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-1310f9f4-165d-4a9a-8341-2b335ea9c78f tempest-GroupSnapshotsTest-435114483 None] Created reservations ['bb9c41f1-5f90-4a6e-ba94-e86081949d1e'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:00:15 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b7eedf71-3be4-4ab9-86e7-64d7b0f74dc3 tempest-SnapshotsActionsTest-1930914051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.info" returned: 0 in 0.263s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b7eedf71-3be4-4ab9-86e7-64d7b0f74dc3 tempest-SnapshotsActionsTest-1930914051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.254s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7b0934c6-6246-4023-b132-4c13bc3a40c1 tempest-VolumesExtendTest-343891008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.671s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:15 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[926f30e5-bc2f-4c42-aecb-6573a1b03425]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7b0934c6-6246-4023-b132-4c13bc3a40c1 tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:15 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-b7eedf71-3be4-4ab9-86e7-64d7b0f74dc3 tempest-SnapshotsActionsTest-1930914051 None] Create snapshot completed successfully Sep 21 12:00:16 devstack cinder-volume[86366]: WARNING cinder.db.api [None req-1310f9f4-165d-4a9a-8341-2b335ea9c78f tempest-GroupSnapshotsTest-435114483 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-228835747'] Sep 21 12:00:16 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-1310f9f4-165d-4a9a-8341-2b335ea9c78f tempest-GroupSnapshotsTest-435114483 None] Created reservations ['1a8018d3-57d3-4a09-b50c-2fd3209d79d4', '26a48fcc-7c03-4c5e-9697-ed6f6b94d502', '7181e68e-7663-487d-9b79-bd9f8e7962a0', '6f7c9719-da9f-4d6f-8402-cd7d125d05ce'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:00:16 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094 Sep 21 12:00:16 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1310f9f4-165d-4a9a-8341-2b335ea9c78f tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1310f9f4-165d-4a9a-8341-2b335ea9c78f tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1310f9f4-165d-4a9a-8341-2b335ea9c78f tempest-GroupSnapshotsTest-435114483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:00:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1310f9f4-165d-4a9a-8341-2b335ea9c78f tempest-GroupSnapshotsTest-435114483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:00:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1310f9f4-165d-4a9a-8341-2b335ea9c78f tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1310f9f4-165d-4a9a-8341-2b335ea9c78f tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:16 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:00:16 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:16 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7b0934c6-6246-4023-b132-4c13bc3a40c1 tempest-VolumesExtendTest-343891008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094" returned: 0 in 0.434s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7b0934c6-6246-4023-b132-4c13bc3a40c1 tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.24d247e8-a96f-4f90-a622-95e8caefb1a6 2G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:16 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1310f9f4-165d-4a9a-8341-2b335ea9c78f tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.300s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:16 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-1310f9f4-165d-4a9a-8341-2b335ea9c78f tempest-GroupSnapshotsTest-435114483 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:00:16 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1310f9f4-165d-4a9a-8341-2b335ea9c78f tempest-GroupSnapshotsTest-435114483 None] Delete group completed successfully. Sep 21 12:00:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7b0934c6-6246-4023-b132-4c13bc3a40c1 tempest-VolumesExtendTest-343891008 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.24d247e8-a96f-4f90-a622-95e8caefb1a6 2G" returned: 0 in 0.174s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7b0934c6-6246-4023-b132-4c13bc3a40c1 tempest-VolumesExtendTest-343891008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.652s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2f9c3870-4514-43b7-9e3b-6b4ad8f80bc2 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.349s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-2f9c3870-4514-43b7-9e3b-6b4ad8f80bc2 tempest-VolumesSnapshotTestJSON-402880464 None] Creating offline snapshot e153927b-2535-4f7f-b540-99e74a4e01e1 of volume 17db2cf7-88ca-4cd0-a7dc-bc2862271994 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:00:16 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca40e66-ff1a-4f48-80f2-b018a4bb3207]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2f9c3870-4514-43b7-9e3b-6b4ad8f80bc2 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:16 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-7b0934c6-6246-4023-b132-4c13bc3a40c1 tempest-VolumesExtendTest-343891008 None] Extend volume completed successfully. Sep 21 12:00:16 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-2ba09cb7-1458-466a-8259-de156a5d19ed tempest-GroupSnapshotsTest-435114483 None] Group tempest-GroupSnapshotsTest-Group-11409044: creating Sep 21 12:00:16 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-2ba09cb7-1458-466a-8259-de156a5d19ed tempest-GroupSnapshotsTest-435114483 None] Group tempest-GroupSnapshotsTest-Group-11409044: created successfully Sep 21 12:00:16 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-2ba09cb7-1458-466a-8259-de156a5d19ed tempest-GroupSnapshotsTest-435114483 None] Create group completed successfully. Sep 21 12:00:16 devstack sudo[96922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994 Sep 21 12:00:16 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:17 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2f9c3870-4514-43b7-9e3b-6b4ad8f80bc2 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994" returned: 0 in 0.440s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2f9c3870-4514-43b7-9e3b-6b4ad8f80bc2 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994.e153927b-2535-4f7f-b540-99e74a4e01e1 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:17 devstack sudo[96927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994.e153927b-2535-4f7f-b540-99e74a4e01e1 1G Sep 21 12:00:17 devstack sudo[96927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7005665b-4244-4fbf-82a8-175b9745ace9 tempest-SnapshotsActionsTest-1930914051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:17 devstack sudo[96927]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2f9c3870-4514-43b7-9e3b-6b4ad8f80bc2 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994.e153927b-2535-4f7f-b540-99e74a4e01e1 1G" returned: 0 in 0.450s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2f9c3870-4514-43b7-9e3b-6b4ad8f80bc2 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994.e153927b-2535-4f7f-b540-99e74a4e01e1 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:17 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994.e153927b-2535-4f7f-b540-99e74a4e01e1 Sep 21 12:00:17 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5244f725-ab2a-41d0-8655-577fcb85e3e1 tempest-VolumesExtendTest-343891008 None] Acquiring lock "cinder-24d247e8-a96f-4f90-a622-95e8caefb1a6-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5244f725-ab2a-41d0-8655-577fcb85e3e1 tempest-VolumesExtendTest-343891008 None] Lock "cinder-24d247e8-a96f-4f90-a622-95e8caefb1a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5244f725-ab2a-41d0-8655-577fcb85e3e1 tempest-VolumesExtendTest-343891008 None] Acquiring lock "cinder-quobyte-9a254b52-d6fa-4f45-a3fa-d22c1de6b094" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5244f725-ab2a-41d0-8655-577fcb85e3e1 tempest-VolumesExtendTest-343891008 None] Lock "cinder-quobyte-9a254b52-d6fa-4f45-a3fa-d22c1de6b094" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5244f725-ab2a-41d0-8655-577fcb85e3e1 tempest-VolumesExtendTest-343891008 None] Acquiring lock "cinder-quobyte-24d247e8-a96f-4f90-a622-95e8caefb1a6" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5244f725-ab2a-41d0-8655-577fcb85e3e1 tempest-VolumesExtendTest-343891008 None] Lock "cinder-quobyte-24d247e8-a96f-4f90-a622-95e8caefb1a6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:17 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-5244f725-ab2a-41d0-8655-577fcb85e3e1 tempest-VolumesExtendTest-343891008 None] Deleting offline snapshot 24d247e8-a96f-4f90-a622-95e8caefb1a6 of volume 9a254b52-d6fa-4f45-a3fa-d22c1de6b094 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:00:17 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-5244f725-ab2a-41d0-8655-577fcb85e3e1 tempest-VolumesExtendTest-343891008 None] snapshot_file for this snap is: volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.24d247e8-a96f-4f90-a622-95e8caefb1a6 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:00:17 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bce630c-c757-4e46-842a-7aeb4373bfc0]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5244f725-ab2a-41d0-8655-577fcb85e3e1 tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.24d247e8-a96f-4f90-a622-95e8caefb1a6 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:17 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2f9c3870-4514-43b7-9e3b-6b4ad8f80bc2 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994.e153927b-2535-4f7f-b540-99e74a4e01e1" returned: 0 in 0.335s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:17 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-2f9c3870-4514-43b7-9e3b-6b4ad8f80bc2 tempest-VolumesSnapshotTestJSON-402880464 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994.e153927b-2535-4f7f-b540-99e74a4e01e1 is being set with open permissions: ugo+rw Sep 21 12:00:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2f9c3870-4514-43b7-9e3b-6b4ad8f80bc2 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994.e153927b-2535-4f7f-b540-99e74a4e01e1 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:17 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994.e153927b-2535-4f7f-b540-99e74a4e01e1 Sep 21 12:00:17 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:17 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.24d247e8-a96f-4f90-a622-95e8caefb1a6 Sep 21 12:00:17 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:18 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2f9c3870-4514-43b7-9e3b-6b4ad8f80bc2 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994.e153927b-2535-4f7f-b540-99e74a4e01e1" returned: 0 in 0.293s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2f9c3870-4514-43b7-9e3b-6b4ad8f80bc2 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:18 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994.info Sep 21 12:00:18 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:18 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5244f725-ab2a-41d0-8655-577fcb85e3e1 tempest-VolumesExtendTest-343891008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.24d247e8-a96f-4f90-a622-95e8caefb1a6" returned: 0 in 0.474s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:18 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-5244f725-ab2a-41d0-8655-577fcb85e3e1 tempest-VolumesExtendTest-343891008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:00:18 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af1d563-d5e9-4431-a33b-a183fe7ef78d]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5244f725-ab2a-41d0-8655-577fcb85e3e1 tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:18 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:00:18 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094 Sep 21 12:00:18 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Flow 'volume_create_manager' (cad973d8-f83b-47bc-b08f-71a655f3ab43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:00:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67051ce2-f008-43e8-ac7e-c5af2e25bb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:18 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67051ce2-f008-43e8-ac7e-c5af2e25bb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-956813784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eae417d4-1885-479c-b90f-9be0ec6a3c5c,host='devstack@QuobyteHD#QuobyteHD',id=e3dba329-94c3-4aa0-b62a-a3d14e84a5e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d775184b136740b78bd9fa4b0e6c376e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:00:18Z,use_quota=True,user_id='7ce00b84d5a2416793336dbaf2dd56b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7c24237-e993-4b45-be20-1f2ebae03437),volume_type_id=b7c24237-e993-4b45-be20-1f2ebae03437)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5932fb52-eb78-4b82-9c44-be50860c346a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5932fb52-eb78-4b82-9c44-be50860c346a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90731f80-f1a9-4515-b930-fe39a870fd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90731f80-f1a9-4515-b930-fe39a870fd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3dba329-94c3-4aa0-b62a-a3d14e84a5e7', 'volume_name': 'volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d709cbe5-50e0-49ae-97ee-ed40c0e98896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d709cbe5-50e0-49ae-97ee-ed40c0e98896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd26416-0753-45ca-a9b8-c0bf1b51fad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:18 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Volume e3dba329-94c3-4aa0-b62a-a3d14e84a5e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7', 'volume_size': 1} Sep 21 12:00:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2f9c3870-4514-43b7-9e3b-6b4ad8f80bc2 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994.info" returned: 0 in 0.377s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:18 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-2f9c3870-4514-43b7-9e3b-6b4ad8f80bc2 tempest-VolumesSnapshotTestJSON-402880464 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994.info is being set with open permissions: ugo+rw Sep 21 12:00:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2f9c3870-4514-43b7-9e3b-6b4ad8f80bc2 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:18 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994.info Sep 21 12:00:18 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:18 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5244f725-ab2a-41d0-8655-577fcb85e3e1 tempest-VolumesExtendTest-343891008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094" returned: 0 in 0.427s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5244f725-ab2a-41d0-8655-577fcb85e3e1 tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.24d247e8-a96f-4f90-a622-95e8caefb1a6 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:18 devstack sudo[96956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.24d247e8-a96f-4f90-a622-95e8caefb1a6 Sep 21 12:00:18 devstack sudo[96956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:18 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2f9c3870-4514-43b7-9e3b-6b4ad8f80bc2 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994.info" returned: 0 in 0.259s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2f9c3870-4514-43b7-9e3b-6b4ad8f80bc2 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.293s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7005665b-4244-4fbf-82a8-175b9745ace9 tempest-SnapshotsActionsTest-1930914051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.557s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:18 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-7005665b-4244-4fbf-82a8-175b9745ace9 tempest-SnapshotsActionsTest-1930914051 None] Creating offline snapshot 47350be4-6a03-4c34-bc1e-3cf6ffa8b77f of volume 5b9f506f-6ddd-485e-bdea-f3f42a527175 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:00:18 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcc0e29-b913-4824-908e-03db171b19d2]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7005665b-4244-4fbf-82a8-175b9745ace9 tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:19 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-2f9c3870-4514-43b7-9e3b-6b4ad8f80bc2 tempest-VolumesSnapshotTestJSON-402880464 None] Create snapshot completed successfully Sep 21 12:00:19 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac Sep 21 12:00:19 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:19 devstack sudo[96956]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5244f725-ab2a-41d0-8655-577fcb85e3e1 tempest-VolumesExtendTest-343891008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.24d247e8-a96f-4f90-a622-95e8caefb1a6" returned: 0 in 0.431s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5244f725-ab2a-41d0-8655-577fcb85e3e1 tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.24d247e8-a96f-4f90-a622-95e8caefb1a6 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:19 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.24d247e8-a96f-4f90-a622-95e8caefb1a6 Sep 21 12:00:19 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:19 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7005665b-4244-4fbf-82a8-175b9745ace9 tempest-SnapshotsActionsTest-1930914051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac" returned: 0 in 0.426s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:19 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-7005665b-4244-4fbf-82a8-175b9745ace9 tempest-SnapshotsActionsTest-1930914051 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b9f506f-6ddd-485e-bdea-f3f42a527175(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:00:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7005665b-4244-4fbf-82a8-175b9745ace9 tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.47350be4-6a03-4c34-bc1e-3cf6ffa8b77f 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:19 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.47350be4-6a03-4c34-bc1e-3cf6ffa8b77f 1G Sep 21 12:00:19 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:19 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5244f725-ab2a-41d0-8655-577fcb85e3e1 tempest-VolumesExtendTest-343891008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094.24d247e8-a96f-4f90-a622-95e8caefb1a6" returned: 0 in 0.282s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5244f725-ab2a-41d0-8655-577fcb85e3e1 tempest-VolumesExtendTest-343891008 None] Lock "cinder-quobyte-24d247e8-a96f-4f90-a622-95e8caefb1a6" released by "_delete_snapshot" :: held 1.784s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5244f725-ab2a-41d0-8655-577fcb85e3e1 tempest-VolumesExtendTest-343891008 None] Lock "cinder-quobyte-9a254b52-d6fa-4f45-a3fa-d22c1de6b094" released by "delete_snapshot" :: held 1.811s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:19 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-5244f725-ab2a-41d0-8655-577fcb85e3e1 tempest-VolumesExtendTest-343891008 None] Created reservations ['3d9844c6-6547-4c75-8d1c-844976f8e759', '2fce9971-9827-4901-9312-148ee1fe67d9', 'bea91b09-4d43-4270-849d-b4815e0439c2', '7d0d1ab7-3070-4a3c-bee2-cf7e7ebd166b'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:00:19 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-5244f725-ab2a-41d0-8655-577fcb85e3e1 tempest-VolumesExtendTest-343891008 None] Delete snapshot completed successfully. Sep 21 12:00:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5244f725-ab2a-41d0-8655-577fcb85e3e1 tempest-VolumesExtendTest-343891008 None] Lock "cinder-24d247e8-a96f-4f90-a622-95e8caefb1a6-delete_snapshot" released by "delete_snapshot" :: held 1.990s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4fcadd8c-05b9-4522-b4de-48bac7c87758 tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "cinder-e153927b-2535-4f7f-b540-99e74a4e01e1-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4fcadd8c-05b9-4522-b4de-48bac7c87758 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-e153927b-2535-4f7f-b540-99e74a4e01e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4fcadd8c-05b9-4522-b4de-48bac7c87758 tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "cinder-quobyte-17db2cf7-88ca-4cd0-a7dc-bc2862271994" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4fcadd8c-05b9-4522-b4de-48bac7c87758 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-17db2cf7-88ca-4cd0-a7dc-bc2862271994" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4fcadd8c-05b9-4522-b4de-48bac7c87758 tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "cinder-quobyte-e153927b-2535-4f7f-b540-99e74a4e01e1" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-33ae6655-dbfa-425a-a051-38cfc70bd9a2 tempest-VolumesExtendTest-343891008 None] Acquiring lock "cinder-9a254b52-d6fa-4f45-a3fa-d22c1de6b094-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4fcadd8c-05b9-4522-b4de-48bac7c87758 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-e153927b-2535-4f7f-b540-99e74a4e01e1" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:19 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-4fcadd8c-05b9-4522-b4de-48bac7c87758 tempest-VolumesSnapshotTestJSON-402880464 None] Deleting offline snapshot e153927b-2535-4f7f-b540-99e74a4e01e1 of volume 17db2cf7-88ca-4cd0-a7dc-bc2862271994 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:00:19 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-4fcadd8c-05b9-4522-b4de-48bac7c87758 tempest-VolumesSnapshotTestJSON-402880464 None] snapshot_file for this snap is: volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994.e153927b-2535-4f7f-b540-99e74a4e01e1 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-33ae6655-dbfa-425a-a051-38cfc70bd9a2 tempest-VolumesExtendTest-343891008 None] Lock "cinder-9a254b52-d6fa-4f45-a3fa-d22c1de6b094-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[560e1dd0-d54f-4e66-8f4a-0940d4b29d85]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4fcadd8c-05b9-4522-b4de-48bac7c87758 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994.e153927b-2535-4f7f-b540-99e74a4e01e1 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:20 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7005665b-4244-4fbf-82a8-175b9745ace9 tempest-SnapshotsActionsTest-1930914051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.47350be4-6a03-4c34-bc1e-3cf6ffa8b77f 1G" returned: 0 in 0.642s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7005665b-4244-4fbf-82a8-175b9745ace9 tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.47350be4-6a03-4c34-bc1e-3cf6ffa8b77f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-33ae6655-dbfa-425a-a051-38cfc70bd9a2 tempest-VolumesExtendTest-343891008 None] Acquiring lock "cinder-quobyte-9a254b52-d6fa-4f45-a3fa-d22c1de6b094" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:20 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.47350be4-6a03-4c34-bc1e-3cf6ffa8b77f Sep 21 12:00:20 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-33ae6655-dbfa-425a-a051-38cfc70bd9a2 tempest-VolumesExtendTest-343891008 None] Lock "cinder-quobyte-9a254b52-d6fa-4f45-a3fa-d22c1de6b094" acquired by "delete_volume" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a034fc-38c2-44da-9b67-c024b9f520b1]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-33ae6655-dbfa-425a-a051-38cfc70bd9a2 tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:20 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994.e153927b-2535-4f7f-b540-99e74a4e01e1 Sep 21 12:00:20 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:20 devstack sudo[96981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094 Sep 21 12:00:20 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:20 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7005665b-4244-4fbf-82a8-175b9745ace9 tempest-SnapshotsActionsTest-1930914051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.47350be4-6a03-4c34-bc1e-3cf6ffa8b77f" returned: 0 in 0.350s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:20 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-7005665b-4244-4fbf-82a8-175b9745ace9 tempest-SnapshotsActionsTest-1930914051 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.47350be4-6a03-4c34-bc1e-3cf6ffa8b77f is being set with open permissions: ugo+rw Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7005665b-4244-4fbf-82a8-175b9745ace9 tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.47350be4-6a03-4c34-bc1e-3cf6ffa8b77f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:20 devstack sudo[96989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.47350be4-6a03-4c34-bc1e-3cf6ffa8b77f Sep 21 12:00:20 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:20 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4fcadd8c-05b9-4522-b4de-48bac7c87758 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994.e153927b-2535-4f7f-b540-99e74a4e01e1" returned: 0 in 0.420s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-4fcadd8c-05b9-4522-b4de-48bac7c87758 tempest-VolumesSnapshotTestJSON-402880464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb61fff-f908-46cd-a88a-2dad8189cc3f]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4fcadd8c-05b9-4522-b4de-48bac7c87758 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:20 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-33ae6655-dbfa-425a-a051-38cfc70bd9a2 tempest-VolumesExtendTest-343891008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094" returned: 0 in 0.431s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-33ae6655-dbfa-425a-a051-38cfc70bd9a2 tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:20 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094 Sep 21 12:00:20 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:20 devstack sudo[96993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994 Sep 21 12:00:20 devstack sudo[96993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:20 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7005665b-4244-4fbf-82a8-175b9745ace9 tempest-SnapshotsActionsTest-1930914051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.47350be4-6a03-4c34-bc1e-3cf6ffa8b77f" returned: 0 in 0.296s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7005665b-4244-4fbf-82a8-175b9745ace9 tempest-SnapshotsActionsTest-1930914051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.844s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.132s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eae417d4-1885-479c-b90f-9be0ec6a3c5c,created_at=2026-09-21T10:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-956813784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eae417d4-1885-479c-b90f-9be0ec6a3c5c,host='devstack@QuobyteHD#QuobyteHD',id=e3dba329-94c3-4aa0-b62a-a3d14e84a5e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d775184b136740b78bd9fa4b0e6c376e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:00:18Z,use_quota=True,user_id='7ce00b84d5a2416793336dbaf2dd56b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7c24237-e993-4b45-be20-1f2ebae03437),volume_type_id=b7c24237-e993-4b45-be20-1f2ebae03437)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Creating volume e3dba329-94c3-4aa0-b62a-a3d14e84a5e7 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:00:20 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:20 devstack sudo[96999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7 1073741824 Sep 21 12:00:20 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:20 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-7005665b-4244-4fbf-82a8-175b9745ace9 tempest-SnapshotsActionsTest-1930914051 None] Create snapshot completed successfully Sep 21 12:00:20 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-33ae6655-dbfa-425a-a051-38cfc70bd9a2 tempest-VolumesExtendTest-343891008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9a254b52-d6fa-4f45-a3fa-d22c1de6b094" returned: 0 in 0.309s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-33ae6655-dbfa-425a-a051-38cfc70bd9a2 tempest-VolumesExtendTest-343891008 None] Lock "cinder-quobyte-9a254b52-d6fa-4f45-a3fa-d22c1de6b094" released by "delete_volume" :: held 0.833s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:20 devstack sudo[96993]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4fcadd8c-05b9-4522-b4de-48bac7c87758 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994" returned: 0 in 0.438s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4fcadd8c-05b9-4522-b4de-48bac7c87758 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994.e153927b-2535-4f7f-b540-99e74a4e01e1 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:20 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994.e153927b-2535-4f7f-b540-99e74a4e01e1 Sep 21 12:00:20 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-33ae6655-dbfa-425a-a051-38cfc70bd9a2 tempest-VolumesExtendTest-343891008 None] Created reservations ['7c95ccaa-dc15-4b9d-8a90-92208177b340', 'f53375dc-77e4-49ee-871f-3d54e4fb4664', '7a74bab1-8bf1-4016-ac18-f315dc4816e3', '1c1a8daa-b496-448e-9db1-09731753d3ff'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-33ae6655-dbfa-425a-a051-38cfc70bd9a2 tempest-VolumesExtendTest-343891008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-33ae6655-dbfa-425a-a051-38cfc70bd9a2 tempest-VolumesExtendTest-343891008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-33ae6655-dbfa-425a-a051-38cfc70bd9a2 tempest-VolumesExtendTest-343891008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-33ae6655-dbfa-425a-a051-38cfc70bd9a2 tempest-VolumesExtendTest-343891008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-33ae6655-dbfa-425a-a051-38cfc70bd9a2 tempest-VolumesExtendTest-343891008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-33ae6655-dbfa-425a-a051-38cfc70bd9a2 tempest-VolumesExtendTest-343891008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:21 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:00:21 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:21 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7 1073741824" returned: 0 in 0.588s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:21 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4fcadd8c-05b9-4522-b4de-48bac7c87758 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994.e153927b-2535-4f7f-b540-99e74a4e01e1" returned: 0 in 0.425s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4fcadd8c-05b9-4522-b4de-48bac7c87758 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994.e153927b-2535-4f7f-b540-99e74a4e01e1 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:21 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994.e153927b-2535-4f7f-b540-99e74a4e01e1 Sep 21 12:00:21 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:21 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7 Sep 21 12:00:21 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:21 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-33ae6655-dbfa-425a-a051-38cfc70bd9a2 tempest-VolumesExtendTest-343891008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.304s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-33ae6655-dbfa-425a-a051-38cfc70bd9a2 tempest-VolumesExtendTest-343891008 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:00:21 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-33ae6655-dbfa-425a-a051-38cfc70bd9a2 tempest-VolumesExtendTest-343891008 None] Deleted volume successfully. Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-33ae6655-dbfa-425a-a051-38cfc70bd9a2 tempest-VolumesExtendTest-343891008 None] Lock "cinder-9a254b52-d6fa-4f45-a3fa-d22c1de6b094-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:21 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4fcadd8c-05b9-4522-b4de-48bac7c87758 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994.e153927b-2535-4f7f-b540-99e74a4e01e1" returned: 0 in 0.320s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:21 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7" returned: 0 in 0.303s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7cf09f3d-ffba-443e-ba02-2656d7d60432 tempest-SnapshotsActionsTest-1132121926 None] Acquiring lock "cinder-47350be4-6a03-4c34-bc1e-3cf6ffa8b77f-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd26416-0753-45ca-a9b8-c0bf1b51fad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fffb4e-6184-48d9-81c5-e0734fa1a2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4fcadd8c-05b9-4522-b4de-48bac7c87758 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-e153927b-2535-4f7f-b540-99e74a4e01e1" released by "_delete_snapshot" :: held 1.811s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:21 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Volume volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7 (e3dba329-94c3-4aa0-b62a-a3d14e84a5e7): created successfully Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fffb4e-6184-48d9-81c5-e0734fa1a2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Flow 'volume_create_manager' (cad973d8-f83b-47bc-b08f-71a655f3ab43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7cf09f3d-ffba-443e-ba02-2656d7d60432 tempest-SnapshotsActionsTest-1132121926 None] Lock "cinder-47350be4-6a03-4c34-bc1e-3cf6ffa8b77f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7cf09f3d-ffba-443e-ba02-2656d7d60432 tempest-SnapshotsActionsTest-1132121926 None] Acquiring lock "cinder-quobyte-5b9f506f-6ddd-485e-bdea-f3f42a527175" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4fcadd8c-05b9-4522-b4de-48bac7c87758 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-17db2cf7-88ca-4cd0-a7dc-bc2862271994" released by "delete_snapshot" :: held 1.872s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:21 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-71ae5928-388d-445a-86b3-8ff77e095d00 tempest-GroupSnapshotsTest-435114483 None] Created volume successfully. Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7cf09f3d-ffba-443e-ba02-2656d7d60432 tempest-SnapshotsActionsTest-1132121926 None] Lock "cinder-quobyte-5b9f506f-6ddd-485e-bdea-f3f42a527175" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7cf09f3d-ffba-443e-ba02-2656d7d60432 tempest-SnapshotsActionsTest-1132121926 None] Acquiring lock "cinder-quobyte-47350be4-6a03-4c34-bc1e-3cf6ffa8b77f" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7cf09f3d-ffba-443e-ba02-2656d7d60432 tempest-SnapshotsActionsTest-1132121926 None] Lock "cinder-quobyte-47350be4-6a03-4c34-bc1e-3cf6ffa8b77f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-7cf09f3d-ffba-443e-ba02-2656d7d60432 tempest-SnapshotsActionsTest-1132121926 None] Deleting offline snapshot 47350be4-6a03-4c34-bc1e-3cf6ffa8b77f of volume 5b9f506f-6ddd-485e-bdea-f3f42a527175 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-7cf09f3d-ffba-443e-ba02-2656d7d60432 tempest-SnapshotsActionsTest-1132121926 None] snapshot_file for this snap is: volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.47350be4-6a03-4c34-bc1e-3cf6ffa8b77f {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fd01a0-469e-4357-a9cf-0b4223eb3b1a]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7cf09f3d-ffba-443e-ba02-2656d7d60432 tempest-SnapshotsActionsTest-1132121926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.47350be4-6a03-4c34-bc1e-3cf6ffa8b77f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:21 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-4fcadd8c-05b9-4522-b4de-48bac7c87758 tempest-VolumesSnapshotTestJSON-402880464 None] Created reservations ['5073aeee-181e-48a9-9f6b-5d647aef8bae', '762b8c0d-2976-424c-924d-c344ac19859d', '39a6f979-52ae-48a1-98e3-6594bf26a8d3', '74817c04-b2c9-48af-81bf-e3c7ec9cc7ea'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:00:22 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-4fcadd8c-05b9-4522-b4de-48bac7c87758 tempest-VolumesSnapshotTestJSON-402880464 None] Delete snapshot completed successfully. Sep 21 12:00:22 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4fcadd8c-05b9-4522-b4de-48bac7c87758 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-e153927b-2535-4f7f-b540-99e74a4e01e1-delete_snapshot" released by "delete_snapshot" :: held 2.177s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:22 devstack sudo[97025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.47350be4-6a03-4c34-bc1e-3cf6ffa8b77f Sep 21 12:00:22 devstack sudo[97025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:22 devstack sudo[97025]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7cf09f3d-ffba-443e-ba02-2656d7d60432 tempest-SnapshotsActionsTest-1132121926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.47350be4-6a03-4c34-bc1e-3cf6ffa8b77f" returned: 0 in 0.484s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-7cf09f3d-ffba-443e-ba02-2656d7d60432 tempest-SnapshotsActionsTest-1132121926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b9f506f-6ddd-485e-bdea-f3f42a527175(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:00:22 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa29cac0-c4e8-4656-8c8b-16a2ba0c7774]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7cf09f3d-ffba-443e-ba02-2656d7d60432 tempest-SnapshotsActionsTest-1132121926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:22 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac Sep 21 12:00:22 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:22 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:00:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Flow 'volume_create_manager' (99e0d340-9ea3-4fd8-bf75-bb6c4d3e8c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:00:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105b96e6-dcd1-42f0-9e20-afdc1f2de08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:22 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7cf09f3d-ffba-443e-ba02-2656d7d60432 tempest-SnapshotsActionsTest-1132121926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac" returned: 0 in 0.468s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-7cf09f3d-ffba-443e-ba02-2656d7d60432 tempest-SnapshotsActionsTest-1132121926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b9f506f-6ddd-485e-bdea-f3f42a527175(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:00:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7cf09f3d-ffba-443e-ba02-2656d7d60432 tempest-SnapshotsActionsTest-1132121926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.47350be4-6a03-4c34-bc1e-3cf6ffa8b77f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:22 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.47350be4-6a03-4c34-bc1e-3cf6ffa8b77f Sep 21 12:00:22 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105b96e6-dcd1-42f0-9e20-afdc1f2de08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-278195307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eae417d4-1885-479c-b90f-9be0ec6a3c5c,host='devstack@QuobyteHD#QuobyteHD',id=b96bbfef-90a0-417c-8e5b-d0856dda33f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d775184b136740b78bd9fa4b0e6c376e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:00:23Z,use_quota=True,user_id='7ce00b84d5a2416793336dbaf2dd56b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7c24237-e993-4b45-be20-1f2ebae03437),volume_type_id=b7c24237-e993-4b45-be20-1f2ebae03437)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2e06b09-724f-4225-9700-245949f3655e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2e06b09-724f-4225-9700-245949f3655e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d248ef7-249c-4190-b964-b258f9862387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d248ef7-249c-4190-b964-b258f9862387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b96bbfef-90a0-417c-8e5b-d0856dda33f4', 'volume_name': 'volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5400d6f-b6ee-443e-b423-dccb21060b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5400d6f-b6ee-443e-b423-dccb21060b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1851e62b-6ad2-41f9-a116-df8f7527d05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:23 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Volume b96bbfef-90a0-417c-8e5b-d0856dda33f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4', 'volume_size': 1} Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eae417d4-1885-479c-b90f-9be0ec6a3c5c,created_at=2026-09-21T10:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-278195307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eae417d4-1885-479c-b90f-9be0ec6a3c5c,host='devstack@QuobyteHD#QuobyteHD',id=b96bbfef-90a0-417c-8e5b-d0856dda33f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d775184b136740b78bd9fa4b0e6c376e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:00:23Z,use_quota=True,user_id='7ce00b84d5a2416793336dbaf2dd56b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7c24237-e993-4b45-be20-1f2ebae03437),volume_type_id=b7c24237-e993-4b45-be20-1f2ebae03437)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Creating volume b96bbfef-90a0-417c-8e5b-d0856dda33f4 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:00:23 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:23 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4 1073741824 Sep 21 12:00:23 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:23 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7cf09f3d-ffba-443e-ba02-2656d7d60432 tempest-SnapshotsActionsTest-1132121926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.47350be4-6a03-4c34-bc1e-3cf6ffa8b77f" returned: 0 in 0.500s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7cf09f3d-ffba-443e-ba02-2656d7d60432 tempest-SnapshotsActionsTest-1132121926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.47350be4-6a03-4c34-bc1e-3cf6ffa8b77f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:23 devstack sudo[97047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.47350be4-6a03-4c34-bc1e-3cf6ffa8b77f Sep 21 12:00:23 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:23 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4 1073741824" returned: 0 in 0.651s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:23 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:00:23 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4 Sep 21 12:00:23 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Flow 'volume_create_manager' (19e2024b-d13d-4d41-8322-fe62380eb9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4472d16-6c0e-4644-8c3b-0fba702caf81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7cf09f3d-ffba-443e-ba02-2656d7d60432 tempest-SnapshotsActionsTest-1132121926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.47350be4-6a03-4c34-bc1e-3cf6ffa8b77f" returned: 0 in 0.385s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7cf09f3d-ffba-443e-ba02-2656d7d60432 tempest-SnapshotsActionsTest-1132121926 None] Lock "cinder-quobyte-47350be4-6a03-4c34-bc1e-3cf6ffa8b77f" released by "_delete_snapshot" :: held 1.966s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4472d16-6c0e-4644-8c3b-0fba702caf81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1289291243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1156b45b-3e7e-46f2-9301-3496714ae3ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b1164abba474a0283c76823e39bcc98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:00:24Z,use_quota=True,user_id='dca8aea142684429b349a15ce64100c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2c419d-a763-4d00-9e1f-ddcfbdcc35a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2c419d-a763-4d00-9e1f-ddcfbdcc35a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44388b60-74ed-4d8b-a704-d3e7b2d7dbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44388b60-74ed-4d8b-a704-d3e7b2d7dbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1156b45b-3e7e-46f2-9301-3496714ae3ed', 'volume_name': 'volume-1156b45b-3e7e-46f2-9301-3496714ae3ed', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab9184c-24a0-4396-8e83-19468a120ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab9184c-24a0-4396-8e83-19468a120ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3f0f75e-83fd-4ab5-8f87-2f7d4ea4f118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:23 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Volume 1156b45b-3e7e-46f2-9301-3496714ae3ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1156b45b-3e7e-46f2-9301-3496714ae3ed', 'volume_size': 1} Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:23 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7cf09f3d-ffba-443e-ba02-2656d7d60432 tempest-SnapshotsActionsTest-1132121926 None] Lock "cinder-quobyte-5b9f506f-6ddd-485e-bdea-f3f42a527175" released by "delete_snapshot" :: held 2.068s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:24 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-7cf09f3d-ffba-443e-ba02-2656d7d60432 tempest-SnapshotsActionsTest-1132121926 None] Created reservations ['7241004d-fc2d-4509-ac28-27eb1fd10840', '90437b4b-98bc-47e4-8af3-51272aa42f37', '0ca6f75e-fd93-464c-9f57-359878f53e99', 'b7a181f7-bd73-45d3-918a-cbb61069fe51'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:00:24 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4" returned: 0 in 0.297s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:24 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:00:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.128s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:24 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1289291243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1156b45b-3e7e-46f2-9301-3496714ae3ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b1164abba474a0283c76823e39bcc98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:00:24Z,use_quota=True,user_id='dca8aea142684429b349a15ce64100c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:00:24 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Creating volume 1156b45b-3e7e-46f2-9301-3496714ae3ed {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:00:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:24 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:00:24 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:00:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:24 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:00:24 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:00:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:24 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed 1073741824 Sep 21 12:00:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1851e62b-6ad2-41f9-a116-df8f7527d05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:24 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (890968a4-bf61-45be-a3fa-dcf7e7f6fe96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:24 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Volume volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4 (b96bbfef-90a0-417c-8e5b-d0856dda33f4): created successfully Sep 21 12:00:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (890968a4-bf61-45be-a3fa-dcf7e7f6fe96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Flow 'volume_create_manager' (99e0d340-9ea3-4fd8-bf75-bb6c4d3e8c1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:00:24 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-5c54b8e8-1ff9-42f9-bd18-f15e4541e617 tempest-GroupSnapshotsTest-435114483 None] Created volume successfully. Sep 21 12:00:24 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-7cf09f3d-ffba-443e-ba02-2656d7d60432 tempest-SnapshotsActionsTest-1132121926 None] Delete snapshot completed successfully. Sep 21 12:00:24 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7cf09f3d-ffba-443e-ba02-2656d7d60432 tempest-SnapshotsActionsTest-1132121926 None] Lock "cinder-47350be4-6a03-4c34-bc1e-3cf6ffa8b77f-delete_snapshot" released by "delete_snapshot" :: held 2.357s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:24 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed 1073741824" returned: 0 in 0.452s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:24 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed Sep 21 12:00:24 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:24 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed" returned: 0 in 0.245s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:24 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:00:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3f0f75e-83fd-4ab5-8f87-2f7d4ea4f118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1156b45b-3e7e-46f2-9301-3496714ae3ed', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b7c128c-7276-4b87-8514-5a7bab27fe3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:24 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Volume volume-1156b45b-3e7e-46f2-9301-3496714ae3ed (1156b45b-3e7e-46f2-9301-3496714ae3ed): created successfully Sep 21 12:00:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b7c128c-7276-4b87-8514-5a7bab27fe3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Flow 'volume_create_manager' (19e2024b-d13d-4d41-8322-fe62380eb9e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:00:24 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-d5c747bf-e2f2-4336-9ecd-5a302e789122 tempest-VolumesSnapshotTestJSON-402880464 None] Created volume successfully. Sep 21 12:00:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-dad3d7d4-819b-4671-8b9e-7ea8f1b74bcd tempest-SnapshotsActionsTest-1930914051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-dad3d7d4-819b-4671-8b9e-7ea8f1b74bcd tempest-SnapshotsActionsTest-1930914051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:25 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-dad3d7d4-819b-4671-8b9e-7ea8f1b74bcd tempest-SnapshotsActionsTest-1930914051 None] Creating offline snapshot cc6f661c-b206-4b69-ad8b-e95931761c29 of volume 5b9f506f-6ddd-485e-bdea-f3f42a527175 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:00:25 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[70426f66-f72b-4761-884e-08a992d949fb]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dad3d7d4-819b-4671-8b9e-7ea8f1b74bcd tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:25 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac Sep 21 12:00:25 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:25 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-420b1cee-36d4-4288-9991-5157d57ad211 tempest-GroupSnapshotsTest-435114483 None] Update group completed successfully. Sep 21 12:00:25 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:00:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Flow 'volume_create_manager' (af7ba4b9-e835-48dc-987f-f4495cde136e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:00:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb382a49-5480-4ea3-ba41-eeb9b91cb661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb382a49-5480-4ea3-ba41-eeb9b91cb661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2070522920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5ed6bc7-a7be-4d73-9523-1d48d8221542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188a77c132e244028c6c8b459ee7e628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:00:26Z,use_quota=True,user_id='b9a2f10f16244e318bd460c8588fdbda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96edb71b-cc3f-40d8-a478-05db13cbca17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96edb71b-cc3f-40d8-a478-05db13cbca17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57d194c8-3260-47f8-8a76-047e52502a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57d194c8-3260-47f8-8a76-047e52502a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5ed6bc7-a7be-4d73-9523-1d48d8221542', 'volume_name': 'volume-b5ed6bc7-a7be-4d73-9523-1d48d8221542', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403f347e-fe8a-4974-a442-50baeeb0ae9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403f347e-fe8a-4974-a442-50baeeb0ae9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9f1714-eb30-4a07-925c-7d024f49dd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:25 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Volume b5ed6bc7-a7be-4d73-9523-1d48d8221542: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5ed6bc7-a7be-4d73-9523-1d48d8221542', 'volume_size': 1} Sep 21 12:00:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:25 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dad3d7d4-819b-4671-8b9e-7ea8f1b74bcd tempest-SnapshotsActionsTest-1930914051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac" returned: 0 in 0.462s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:25 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-dad3d7d4-819b-4671-8b9e-7ea8f1b74bcd tempest-SnapshotsActionsTest-1930914051 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b9f506f-6ddd-485e-bdea-f3f42a527175(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:00:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dad3d7d4-819b-4671-8b9e-7ea8f1b74bcd tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.cc6f661c-b206-4b69-ad8b-e95931761c29 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:25 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.cc6f661c-b206-4b69-ad8b-e95931761c29 1G Sep 21 12:00:25 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6fa1a618-0edb-4fbb-91e6-1de965327fe7 tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:26 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dad3d7d4-819b-4671-8b9e-7ea8f1b74bcd tempest-SnapshotsActionsTest-1930914051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.cc6f661c-b206-4b69-ad8b-e95931761c29 1G" returned: 0 in 0.433s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dad3d7d4-819b-4671-8b9e-7ea8f1b74bcd tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.cc6f661c-b206-4b69-ad8b-e95931761c29 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:26 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.cc6f661c-b206-4b69-ad8b-e95931761c29 Sep 21 12:00:26 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:26 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dad3d7d4-819b-4671-8b9e-7ea8f1b74bcd tempest-SnapshotsActionsTest-1930914051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.cc6f661c-b206-4b69-ad8b-e95931761c29" returned: 0 in 0.287s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:26 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-dad3d7d4-819b-4671-8b9e-7ea8f1b74bcd tempest-SnapshotsActionsTest-1930914051 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.cc6f661c-b206-4b69-ad8b-e95931761c29 is being set with open permissions: ugo+rw Sep 21 12:00:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dad3d7d4-819b-4671-8b9e-7ea8f1b74bcd tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.cc6f661c-b206-4b69-ad8b-e95931761c29 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:26 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.cc6f661c-b206-4b69-ad8b-e95931761c29 Sep 21 12:00:26 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:26 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-e081e9ad-9cfc-4ab4-a763-f5b1c25292be tempest-GroupSnapshotsTest-435114483 None] Update group completed successfully. Sep 21 12:00:26 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dad3d7d4-819b-4671-8b9e-7ea8f1b74bcd tempest-SnapshotsActionsTest-1930914051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.cc6f661c-b206-4b69-ad8b-e95931761c29" returned: 0 in 0.252s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-dad3d7d4-819b-4671-8b9e-7ea8f1b74bcd tempest-SnapshotsActionsTest-1930914051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.562s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.101s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:26 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2070522920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5ed6bc7-a7be-4d73-9523-1d48d8221542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188a77c132e244028c6c8b459ee7e628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:00:26Z,use_quota=True,user_id='b9a2f10f16244e318bd460c8588fdbda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:00:26 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Creating volume b5ed6bc7-a7be-4d73-9523-1d48d8221542 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:00:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:26 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:00:26 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:00:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:26 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:00:26 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:00:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b5ed6bc7-a7be-4d73-9523-1d48d8221542 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:26 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b5ed6bc7-a7be-4d73-9523-1d48d8221542 1073741824 Sep 21 12:00:26 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:26 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-dad3d7d4-819b-4671-8b9e-7ea8f1b74bcd tempest-SnapshotsActionsTest-1930914051 None] Create snapshot completed successfully Sep 21 12:00:27 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b5ed6bc7-a7be-4d73-9523-1d48d8221542 1073741824" returned: 0 in 0.452s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b5ed6bc7-a7be-4d73-9523-1d48d8221542 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:27 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b5ed6bc7-a7be-4d73-9523-1d48d8221542 Sep 21 12:00:27 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:27 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b5ed6bc7-a7be-4d73-9523-1d48d8221542" returned: 0 in 0.259s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:00:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6fa1a618-0edb-4fbb-91e6-1de965327fe7 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.704s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-6fa1a618-0edb-4fbb-91e6-1de965327fe7 tempest-VolumesSnapshotTestJSON-402880464 None] Creating offline snapshot cde9e453-5176-4c4d-a516-0df6764a0d6f of volume 1156b45b-3e7e-46f2-9301-3496714ae3ed {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:00:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9f1714-eb30-4a07-925c-7d024f49dd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5ed6bc7-a7be-4d73-9523-1d48d8221542', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05018d9d-fc52-40f9-a32f-230976a5deac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:27 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-ed79703d-8fb2-49ab-aae6-01597deeb36a tempest-SnapshotsActionsTest-1132121926 None] Acquiring lock "cinder-cc6f661c-b206-4b69-ad8b-e95931761c29-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:27 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc21fff6-3e4d-4086-bc00-f336d35de221]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6fa1a618-0edb-4fbb-91e6-1de965327fe7 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:27 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Volume volume-b5ed6bc7-a7be-4d73-9523-1d48d8221542 (b5ed6bc7-a7be-4d73-9523-1d48d8221542): created successfully Sep 21 12:00:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05018d9d-fc52-40f9-a32f-230976a5deac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Flow 'volume_create_manager' (af7ba4b9-e835-48dc-987f-f4495cde136e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:00:27 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-ed79703d-8fb2-49ab-aae6-01597deeb36a tempest-SnapshotsActionsTest-1132121926 None] Lock "cinder-cc6f661c-b206-4b69-ad8b-e95931761c29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:27 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-ed79703d-8fb2-49ab-aae6-01597deeb36a tempest-SnapshotsActionsTest-1132121926 None] Acquiring lock "cinder-quobyte-5b9f506f-6ddd-485e-bdea-f3f42a527175" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:27 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-430dc0f4-c869-4f4e-8140-058713cd10d4 tempest-VolumesNegativeTest-485086136 None] Created volume successfully. Sep 21 12:00:27 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-ed79703d-8fb2-49ab-aae6-01597deeb36a tempest-SnapshotsActionsTest-1132121926 None] Lock "cinder-quobyte-5b9f506f-6ddd-485e-bdea-f3f42a527175" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:27 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-ed79703d-8fb2-49ab-aae6-01597deeb36a tempest-SnapshotsActionsTest-1132121926 None] Acquiring lock "cinder-quobyte-cc6f661c-b206-4b69-ad8b-e95931761c29" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:27 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-ed79703d-8fb2-49ab-aae6-01597deeb36a tempest-SnapshotsActionsTest-1132121926 None] Lock "cinder-quobyte-cc6f661c-b206-4b69-ad8b-e95931761c29" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-ed79703d-8fb2-49ab-aae6-01597deeb36a tempest-SnapshotsActionsTest-1132121926 None] Deleting offline snapshot cc6f661c-b206-4b69-ad8b-e95931761c29 of volume 5b9f506f-6ddd-485e-bdea-f3f42a527175 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:00:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-ed79703d-8fb2-49ab-aae6-01597deeb36a tempest-SnapshotsActionsTest-1132121926 None] snapshot_file for this snap is: volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.cc6f661c-b206-4b69-ad8b-e95931761c29 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:00:27 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed Sep 21 12:00:27 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:27 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[10525f07-6e73-4ea3-b4dc-e5a8ff0d380f]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ed79703d-8fb2-49ab-aae6-01597deeb36a tempest-SnapshotsActionsTest-1132121926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.cc6f661c-b206-4b69-ad8b-e95931761c29 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:27 devstack sudo[97096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.cc6f661c-b206-4b69-ad8b-e95931761c29 Sep 21 12:00:27 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:28 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-abe83f85-ebcb-415d-b8d5-1d2be1e09ce4 tempest-GroupSnapshotsTest-435114483 None] Update group completed successfully. Sep 21 12:00:28 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6fa1a618-0edb-4fbb-91e6-1de965327fe7 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed" returned: 0 in 0.450s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6fa1a618-0edb-4fbb-91e6-1de965327fe7 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.cde9e453-5176-4c4d-a516-0df6764a0d6f 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:28 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.cde9e453-5176-4c4d-a516-0df6764a0d6f 1G Sep 21 12:00:28 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:28 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ed79703d-8fb2-49ab-aae6-01597deeb36a tempest-SnapshotsActionsTest-1132121926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.cc6f661c-b206-4b69-ad8b-e95931761c29" returned: 0 in 0.403s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:28 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-ed79703d-8fb2-49ab-aae6-01597deeb36a tempest-SnapshotsActionsTest-1132121926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b9f506f-6ddd-485e-bdea-f3f42a527175(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:00:28 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9422d9-c57c-4ed8-ae21-2624908043f7]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ed79703d-8fb2-49ab-aae6-01597deeb36a tempest-SnapshotsActionsTest-1132121926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:28 devstack sudo[97106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac Sep 21 12:00:28 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:28 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6fa1a618-0edb-4fbb-91e6-1de965327fe7 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.cde9e453-5176-4c4d-a516-0df6764a0d6f 1G" returned: 0 in 0.420s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6fa1a618-0edb-4fbb-91e6-1de965327fe7 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1156b45b-3e7e-46f2-9301-3496714ae3ed -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.cde9e453-5176-4c4d-a516-0df6764a0d6f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:28 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1156b45b-3e7e-46f2-9301-3496714ae3ed -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.cde9e453-5176-4c4d-a516-0df6764a0d6f Sep 21 12:00:28 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:28 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ed79703d-8fb2-49ab-aae6-01597deeb36a tempest-SnapshotsActionsTest-1132121926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac" returned: 0 in 0.465s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:28 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-ed79703d-8fb2-49ab-aae6-01597deeb36a tempest-SnapshotsActionsTest-1132121926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b9f506f-6ddd-485e-bdea-f3f42a527175(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:00:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ed79703d-8fb2-49ab-aae6-01597deeb36a tempest-SnapshotsActionsTest-1132121926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.cc6f661c-b206-4b69-ad8b-e95931761c29 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:28 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.cc6f661c-b206-4b69-ad8b-e95931761c29 Sep 21 12:00:28 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:28 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6fa1a618-0edb-4fbb-91e6-1de965327fe7 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1156b45b-3e7e-46f2-9301-3496714ae3ed -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.cde9e453-5176-4c4d-a516-0df6764a0d6f" returned: 0 in 0.337s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:28 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-6fa1a618-0edb-4fbb-91e6-1de965327fe7 tempest-VolumesSnapshotTestJSON-402880464 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.cde9e453-5176-4c4d-a516-0df6764a0d6f is being set with open permissions: ugo+rw Sep 21 12:00:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6fa1a618-0edb-4fbb-91e6-1de965327fe7 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.cde9e453-5176-4c4d-a516-0df6764a0d6f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:28 devstack sudo[97124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.cde9e453-5176-4c4d-a516-0df6764a0d6f Sep 21 12:00:28 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:29 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-2367d364-a254-44e5-bdb0-7b670e001152 tempest-GroupSnapshotsTest-435114483 None] Update group completed successfully. Sep 21 12:00:29 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6fa1a618-0edb-4fbb-91e6-1de965327fe7 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.cde9e453-5176-4c4d-a516-0df6764a0d6f" returned: 0 in 0.313s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:29 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ed79703d-8fb2-49ab-aae6-01597deeb36a tempest-SnapshotsActionsTest-1132121926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.cc6f661c-b206-4b69-ad8b-e95931761c29" returned: 0 in 0.497s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ed79703d-8fb2-49ab-aae6-01597deeb36a tempest-SnapshotsActionsTest-1132121926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.cc6f661c-b206-4b69-ad8b-e95931761c29 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:29 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.cc6f661c-b206-4b69-ad8b-e95931761c29 Sep 21 12:00:29 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6fa1a618-0edb-4fbb-91e6-1de965327fe7 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:29 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.info Sep 21 12:00:29 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:29 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ed79703d-8fb2-49ab-aae6-01597deeb36a tempest-SnapshotsActionsTest-1132121926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.cc6f661c-b206-4b69-ad8b-e95931761c29" returned: 0 in 0.262s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:29 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-ed79703d-8fb2-49ab-aae6-01597deeb36a tempest-SnapshotsActionsTest-1132121926 None] Lock "cinder-quobyte-cc6f661c-b206-4b69-ad8b-e95931761c29" released by "_delete_snapshot" :: held 1.759s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:29 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:29 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-ed79703d-8fb2-49ab-aae6-01597deeb36a tempest-SnapshotsActionsTest-1132121926 None] Lock "cinder-quobyte-5b9f506f-6ddd-485e-bdea-f3f42a527175" released by "delete_snapshot" :: held 1.787s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6fa1a618-0edb-4fbb-91e6-1de965327fe7 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.info" returned: 0 in 0.278s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:29 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-6fa1a618-0edb-4fbb-91e6-1de965327fe7 tempest-VolumesSnapshotTestJSON-402880464 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.info is being set with open permissions: ugo+rw Sep 21 12:00:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6fa1a618-0edb-4fbb-91e6-1de965327fe7 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:29 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.info Sep 21 12:00:29 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:29 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-ed79703d-8fb2-49ab-aae6-01597deeb36a tempest-SnapshotsActionsTest-1132121926 None] Created reservations ['07bdfb26-7514-4244-add3-f28a5f51a8e6', '800cd1fe-a4d2-4bca-8077-29b822131489', '6ac8628c-bf21-4b1c-a480-d59c8075b7ee', '943462de-636c-4dc6-9234-131280cd89fe'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:00:29 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-ed79703d-8fb2-49ab-aae6-01597deeb36a tempest-SnapshotsActionsTest-1132121926 None] Delete snapshot completed successfully. Sep 21 12:00:29 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-ed79703d-8fb2-49ab-aae6-01597deeb36a tempest-SnapshotsActionsTest-1132121926 None] Lock "cinder-cc6f661c-b206-4b69-ad8b-e95931761c29-delete_snapshot" released by "delete_snapshot" :: held 1.965s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:29 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6fa1a618-0edb-4fbb-91e6-1de965327fe7 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.info" returned: 0 in 0.361s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6fa1a618-0edb-4fbb-91e6-1de965327fe7 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.337s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:30 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-6fa1a618-0edb-4fbb-91e6-1de965327fe7 tempest-VolumesSnapshotTestJSON-402880464 None] Create snapshot completed successfully Sep 21 12:00:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3c12a262-b772-4038-b850-d745dfe1ea28 tempest-SnapshotsActionsTest-1930914051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3c12a262-b772-4038-b850-d745dfe1ea28 tempest-SnapshotsActionsTest-1930914051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:30 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-3c12a262-b772-4038-b850-d745dfe1ea28 tempest-SnapshotsActionsTest-1930914051 None] Creating offline snapshot 8c55084c-94ac-4e7f-a312-4a17fff91bbb of volume 5b9f506f-6ddd-485e-bdea-f3f42a527175 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:00:30 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52d4853-68f2-46fa-98f7-60d1c14ec1cc]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3c12a262-b772-4038-b850-d745dfe1ea28 tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:30 devstack sudo[97143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac Sep 21 12:00:30 devstack sudo[97143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:31 devstack sudo[97143]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3c12a262-b772-4038-b850-d745dfe1ea28 tempest-SnapshotsActionsTest-1930914051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac" returned: 0 in 0.589s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-3c12a262-b772-4038-b850-d745dfe1ea28 tempest-SnapshotsActionsTest-1930914051 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b9f506f-6ddd-485e-bdea-f3f42a527175(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:00:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3c12a262-b772-4038-b850-d745dfe1ea28 tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.8c55084c-94ac-4e7f-a312-4a17fff91bbb 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:31 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:00:31 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.8c55084c-94ac-4e7f-a312-4a17fff91bbb 1G Sep 21 12:00:31 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:31 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] GroupSnapshot f4f54669-4d4c-4c9d-9e82-2f14bffd47c6: creating. Sep 21 12:00:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Flow 'volume_create_manager' (32467538-e3f8-419b-a4ea-352faaef12da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:00:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea827382-5852-417b-8507-36aaeb99c46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea827382-5852-417b-8507-36aaeb99c46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-768931323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f23f47b9-d156-47d1-9549-2ea076c454e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b1164abba474a0283c76823e39bcc98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:00:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=cde9e453-5176-4c4d-a516-0df6764a0d6f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:00:31Z,use_quota=True,user_id='dca8aea142684429b349a15ce64100c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74901185-ae9e-48c9-810d-8aeb3dbc048e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74901185-ae9e-48c9-810d-8aeb3dbc048e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5fbc27-721a-4321-8114-204c2e7158a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a5fbc27-721a-4321-8114-204c2e7158a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f23f47b9-d156-47d1-9549-2ea076c454e2', 'volume_name': 'volume-f23f47b9-d156-47d1-9549-2ea076c454e2', 'volume_size': 2, 'snapshot_id': 'cde9e453-5176-4c4d-a516-0df6764a0d6f'}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c85cc6ef-3f5d-4584-889d-c10de18872da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c85cc6ef-3f5d-4584-889d-c10de18872da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6b233f-44ba-4fba-b591-32c68feed0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:31 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Volume f23f47b9-d156-47d1-9549-2ea076c454e2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f23f47b9-d156-47d1-9549-2ea076c454e2', 'volume_size': 2, 'snapshot_id': 'cde9e453-5176-4c4d-a516-0df6764a0d6f'} Sep 21 12:00:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] Group snapshot f4f54669-4d4c-4c9d-9e82-2f14bffd47c6: creating. {{(pid=86366) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 21 12:00:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:31 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3c12a262-b772-4038-b850-d745dfe1ea28 tempest-SnapshotsActionsTest-1930914051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.8c55084c-94ac-4e7f-a312-4a17fff91bbb 1G" returned: 0 in 0.708s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3c12a262-b772-4038-b850-d745dfe1ea28 tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.8c55084c-94ac-4e7f-a312-4a17fff91bbb {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:31 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.8c55084c-94ac-4e7f-a312-4a17fff91bbb Sep 21 12:00:31 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:32 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3c12a262-b772-4038-b850-d745dfe1ea28 tempest-SnapshotsActionsTest-1930914051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.8c55084c-94ac-4e7f-a312-4a17fff91bbb" returned: 0 in 0.376s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:32 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-3c12a262-b772-4038-b850-d745dfe1ea28 tempest-SnapshotsActionsTest-1930914051 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.8c55084c-94ac-4e7f-a312-4a17fff91bbb is being set with open permissions: ugo+rw Sep 21 12:00:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3c12a262-b772-4038-b850-d745dfe1ea28 tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.8c55084c-94ac-4e7f-a312-4a17fff91bbb {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:32 devstack sudo[97170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.8c55084c-94ac-4e7f-a312-4a17fff91bbb Sep 21 12:00:32 devstack sudo[97170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:32 devstack sudo[97170]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3c12a262-b772-4038-b850-d745dfe1ea28 tempest-SnapshotsActionsTest-1930914051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.8c55084c-94ac-4e7f-a312-4a17fff91bbb" returned: 0 in 0.284s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3c12a262-b772-4038-b850-d745dfe1ea28 tempest-SnapshotsActionsTest-1930914051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.112s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.168s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:32 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "cinder-quobyte-cde9e453-5176-4c4d-a516-0df6764a0d6f-f23f47b9-d156-47d1-9549-2ea076c454e2" by "_create_volume_from_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:32 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-cde9e453-5176-4c4d-a516-0df6764a0d6f-f23f47b9-d156-47d1-9549-2ea076c454e2" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Creating volume f23f47b9-d156-47d1-9549-2ea076c454e2 from snapshot cde9e453-5176-4c4d-a516-0df6764a0d6f {{(pid=86366) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 21 12:00:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:00:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:00:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:00:32 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "cinder-quobyte-f23f47b9-d156-47d1-9549-2ea076c454e2" by "_copy_volume_from_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:32 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-3c12a262-b772-4038-b850-d745dfe1ea28 tempest-SnapshotsActionsTest-1930914051 None] Create snapshot completed successfully Sep 21 12:00:32 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-f23f47b9-d156-47d1-9549-2ea076c454e2" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] snapshot: cde9e453-5176-4c4d-a516-0df6764a0d6f, volume: f23f47b9-d156-47d1-9549-2ea076c454e2, {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 21 12:00:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:00:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:00:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:32 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffa589e-9ac5-4e6d-8ba7-29c64a896aab]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.cde9e453-5176-4c4d-a516-0df6764a0d6f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:32 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.cde9e453-5176-4c4d-a516-0df6764a0d6f Sep 21 12:00:32 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:33 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.cde9e453-5176-4c4d-a516-0df6764a0d6f" returned: 0 in 0.462s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1156b45b-3e7e-46f2-9301-3496714ae3ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:00:33 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55aede3-2e75-4627-aa58-d515387f49fa]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:33 devstack sudo[97183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed Sep 21 12:00:33 devstack sudo[97183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:33 devstack sudo[97183]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed" returned: 0 in 0.389s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 21 12:00:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Creating direct copy from snapshot {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 21 12:00:33 devstack cinder-volume[86366]: DEBUG cinder.utils [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Path /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f23f47b9-d156-47d1-9549-2ea076c454e2 not found in is_blk_device check {{(pid=86366) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 21 12:00:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f23f47b9-d156-47d1-9549-2ea076c454e2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:33 devstack sudo[97188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f23f47b9-d156-47d1-9549-2ea076c454e2 Sep 21 12:00:33 devstack sudo[97188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-433b77c2-94a3-4f51-a98e-4b96172d1ec0 tempest-SnapshotsActionsTest-1132121926 None] Acquiring lock "cinder-8c55084c-94ac-4e7f-a312-4a17fff91bbb-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-433b77c2-94a3-4f51-a98e-4b96172d1ec0 tempest-SnapshotsActionsTest-1132121926 None] Lock "cinder-8c55084c-94ac-4e7f-a312-4a17fff91bbb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-433b77c2-94a3-4f51-a98e-4b96172d1ec0 tempest-SnapshotsActionsTest-1132121926 None] Acquiring lock "cinder-quobyte-5b9f506f-6ddd-485e-bdea-f3f42a527175" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-433b77c2-94a3-4f51-a98e-4b96172d1ec0 tempest-SnapshotsActionsTest-1132121926 None] Lock "cinder-quobyte-5b9f506f-6ddd-485e-bdea-f3f42a527175" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-433b77c2-94a3-4f51-a98e-4b96172d1ec0 tempest-SnapshotsActionsTest-1132121926 None] Acquiring lock "cinder-quobyte-8c55084c-94ac-4e7f-a312-4a17fff91bbb" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-433b77c2-94a3-4f51-a98e-4b96172d1ec0 tempest-SnapshotsActionsTest-1132121926 None] Lock "cinder-quobyte-8c55084c-94ac-4e7f-a312-4a17fff91bbb" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-433b77c2-94a3-4f51-a98e-4b96172d1ec0 tempest-SnapshotsActionsTest-1132121926 None] Deleting offline snapshot 8c55084c-94ac-4e7f-a312-4a17fff91bbb of volume 5b9f506f-6ddd-485e-bdea-f3f42a527175 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:00:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-433b77c2-94a3-4f51-a98e-4b96172d1ec0 tempest-SnapshotsActionsTest-1132121926 None] snapshot_file for this snap is: volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.8c55084c-94ac-4e7f-a312-4a17fff91bbb {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:00:33 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac09770-9b11-44ea-b026-d39b257ac051]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-433b77c2-94a3-4f51-a98e-4b96172d1ec0 tempest-SnapshotsActionsTest-1132121926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.8c55084c-94ac-4e7f-a312-4a17fff91bbb {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:33 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.8c55084c-94ac-4e7f-a312-4a17fff91bbb Sep 21 12:00:33 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:34 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-433b77c2-94a3-4f51-a98e-4b96172d1ec0 tempest-SnapshotsActionsTest-1132121926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.8c55084c-94ac-4e7f-a312-4a17fff91bbb" returned: 0 in 0.595s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:34 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-433b77c2-94a3-4f51-a98e-4b96172d1ec0 tempest-SnapshotsActionsTest-1132121926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b9f506f-6ddd-485e-bdea-f3f42a527175(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:00:34 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f5dfb6-7244-4c6e-9bbc-5771544aef93]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-433b77c2-94a3-4f51-a98e-4b96172d1ec0 tempest-SnapshotsActionsTest-1132121926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:34 devstack sudo[97208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac Sep 21 12:00:34 devstack sudo[97208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:35 devstack sudo[97208]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-433b77c2-94a3-4f51-a98e-4b96172d1ec0 tempest-SnapshotsActionsTest-1132121926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac" returned: 0 in 0.904s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-433b77c2-94a3-4f51-a98e-4b96172d1ec0 tempest-SnapshotsActionsTest-1132121926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b9f506f-6ddd-485e-bdea-f3f42a527175(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:00:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-433b77c2-94a3-4f51-a98e-4b96172d1ec0 tempest-SnapshotsActionsTest-1132121926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.8c55084c-94ac-4e7f-a312-4a17fff91bbb {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:35 devstack sudo[97214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.8c55084c-94ac-4e7f-a312-4a17fff91bbb Sep 21 12:00:35 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:36 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-433b77c2-94a3-4f51-a98e-4b96172d1ec0 tempest-SnapshotsActionsTest-1132121926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.8c55084c-94ac-4e7f-a312-4a17fff91bbb" returned: 0 in 1.314s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-433b77c2-94a3-4f51-a98e-4b96172d1ec0 tempest-SnapshotsActionsTest-1132121926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.8c55084c-94ac-4e7f-a312-4a17fff91bbb {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:36 devstack sudo[97274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.8c55084c-94ac-4e7f-a312-4a17fff91bbb Sep 21 12:00:36 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:37 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-433b77c2-94a3-4f51-a98e-4b96172d1ec0 tempest-SnapshotsActionsTest-1132121926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.8c55084c-94ac-4e7f-a312-4a17fff91bbb" returned: 0 in 0.703s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-433b77c2-94a3-4f51-a98e-4b96172d1ec0 tempest-SnapshotsActionsTest-1132121926 None] Lock "cinder-quobyte-8c55084c-94ac-4e7f-a312-4a17fff91bbb" released by "_delete_snapshot" :: held 3.770s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-433b77c2-94a3-4f51-a98e-4b96172d1ec0 tempest-SnapshotsActionsTest-1132121926 None] Lock "cinder-quobyte-5b9f506f-6ddd-485e-bdea-f3f42a527175" released by "delete_snapshot" :: held 3.812s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:37 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-433b77c2-94a3-4f51-a98e-4b96172d1ec0 tempest-SnapshotsActionsTest-1132121926 None] Created reservations ['0ca29d0c-d6c2-41ee-8919-ad1bda43ded6', 'df1ef862-5fec-4c2a-88a6-ece2b96d4a15', 'a70daced-4420-4700-90a7-5d1a9e32bcf6', 'a805031a-0109-45b7-84d0-8ca442b2cec6'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:00:37 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-433b77c2-94a3-4f51-a98e-4b96172d1ec0 tempest-SnapshotsActionsTest-1132121926 None] Delete snapshot completed successfully. Sep 21 12:00:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-433b77c2-94a3-4f51-a98e-4b96172d1ec0 tempest-SnapshotsActionsTest-1132121926 None] Lock "cinder-8c55084c-94ac-4e7f-a312-4a17fff91bbb-delete_snapshot" released by "delete_snapshot" :: held 4.207s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-85494a0a-c3aa-4e17-9841-83d881d6396a tempest-SnapshotsActionsTest-1930914051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:42 devstack sudo[97188]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f23f47b9-d156-47d1-9549-2ea076c454e2" returned: 0 in 9.313s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:42 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Image conversion details: src /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed, size 1024.00 MB, duration 9.31 sec, destination /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f23f47b9-d156-47d1-9549-2ea076c454e2 {{(pid=86366) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 12:00:42 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Converted 1024.00 MB image at 109.95 MB/s Sep 21 12:00:42 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f23f47b9-d156-47d1-9549-2ea076c454e2 is being set with open permissions: ugo+rw Sep 21 12:00:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f23f47b9-d156-47d1-9549-2ea076c454e2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:42 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f23f47b9-d156-47d1-9549-2ea076c454e2 Sep 21 12:00:42 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:43 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f23f47b9-d156-47d1-9549-2ea076c454e2" returned: 0 in 0.293s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:43 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-f23f47b9-d156-47d1-9549-2ea076c454e2" released by "_copy_volume_from_snapshot" :: held 10.565s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:43 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-cde9e453-5176-4c4d-a516-0df6764a0d6f-f23f47b9-d156-47d1-9549-2ea076c454e2" released by "_create_volume_from_snapshot" :: held 10.647s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.678s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.838s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:43 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] Creating offline snapshot 735821b1-d052-4f5e-a1ff-e6a5be922d7f of volume b96bbfef-90a0-417c-8e5b-d0856dda33f4 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:00:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6b233f-44ba-4fba-b591-32c68feed0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f23f47b9-d156-47d1-9549-2ea076c454e2', 'volume_size': 2, 'snapshot_id': 'cde9e453-5176-4c4d-a516-0df6764a0d6f'}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1530fa8d-28ca-46c2-8f04-e66b61359cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:43 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51daea0-4c36-4b47-831b-cbb474d9458a]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:43 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Volume volume-f23f47b9-d156-47d1-9549-2ea076c454e2 (f23f47b9-d156-47d1-9549-2ea076c454e2): created successfully Sep 21 12:00:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1530fa8d-28ca-46c2-8f04-e66b61359cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Flow 'volume_create_manager' (32467538-e3f8-419b-a4ea-352faaef12da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:00:43 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-faa638a1-1401-4ce1-a9a4-9deef0af0c33 tempest-VolumesSnapshotTestJSON-402880464 None] Created volume successfully. Sep 21 12:00:43 devstack sudo[97316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4 Sep 21 12:00:43 devstack sudo[97316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:43 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6ae036c6-e37f-4f27-8856-d100eae3d6ef tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "cinder-f23f47b9-d156-47d1-9549-2ea076c454e2-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:43 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6ae036c6-e37f-4f27-8856-d100eae3d6ef tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-f23f47b9-d156-47d1-9549-2ea076c454e2-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:43 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6ae036c6-e37f-4f27-8856-d100eae3d6ef tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "cinder-quobyte-f23f47b9-d156-47d1-9549-2ea076c454e2" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:43 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6ae036c6-e37f-4f27-8856-d100eae3d6ef tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-f23f47b9-d156-47d1-9549-2ea076c454e2" acquired by "delete_volume" :: waited 0.018s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:43 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be7627c-c699-482f-a9df-c5822610f77a]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6ae036c6-e37f-4f27-8856-d100eae3d6ef tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f23f47b9-d156-47d1-9549-2ea076c454e2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:43 devstack sudo[97316]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4" returned: 0 in 0.578s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4.735821b1-d052-4f5e-a1ff-e6a5be922d7f 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:43 devstack sudo[97325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4.735821b1-d052-4f5e-a1ff-e6a5be922d7f 1G Sep 21 12:00:43 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:43 devstack sudo[97324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f23f47b9-d156-47d1-9549-2ea076c454e2 Sep 21 12:00:43 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:44 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6ae036c6-e37f-4f27-8856-d100eae3d6ef tempest-VolumesSnapshotTestJSON-402880464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f23f47b9-d156-47d1-9549-2ea076c454e2" returned: 0 in 0.480s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6ae036c6-e37f-4f27-8856-d100eae3d6ef tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f23f47b9-d156-47d1-9549-2ea076c454e2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:44 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f23f47b9-d156-47d1-9549-2ea076c454e2 Sep 21 12:00:44 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:44 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4.735821b1-d052-4f5e-a1ff-e6a5be922d7f 1G" returned: 0 in 0.545s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4.735821b1-d052-4f5e-a1ff-e6a5be922d7f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:44 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4.735821b1-d052-4f5e-a1ff-e6a5be922d7f Sep 21 12:00:44 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:44 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6ae036c6-e37f-4f27-8856-d100eae3d6ef tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f23f47b9-d156-47d1-9549-2ea076c454e2" returned: 0 in 0.272s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:44 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6ae036c6-e37f-4f27-8856-d100eae3d6ef tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-f23f47b9-d156-47d1-9549-2ea076c454e2" released by "delete_volume" :: held 0.802s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:44 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=156,cinder:INSERT=40,cinder:UPDATE=167,cinder:DELETE=13 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:00:44 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=174,cinder:INSERT=44,cinder:UPDATE=143,cinder:DELETE=9 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:00:44 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-6ae036c6-e37f-4f27-8856-d100eae3d6ef tempest-VolumesSnapshotTestJSON-402880464 None] Created reservations ['9c9c0376-3dc6-4c34-abee-61431f61bc0b', '9fa010c2-d7bc-40ef-9377-0a38ec4b981e', '5903dda8-f97c-4483-9692-e641b876e4ff', '1f519794-a72b-493e-a2d3-bbfa89b17c1d'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:00:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6ae036c6-e37f-4f27-8856-d100eae3d6ef tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6ae036c6-e37f-4f27-8856-d100eae3d6ef tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6ae036c6-e37f-4f27-8856-d100eae3d6ef tempest-VolumesSnapshotTestJSON-402880464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:00:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6ae036c6-e37f-4f27-8856-d100eae3d6ef tempest-VolumesSnapshotTestJSON-402880464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:00:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6ae036c6-e37f-4f27-8856-d100eae3d6ef tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6ae036c6-e37f-4f27-8856-d100eae3d6ef tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:44 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4.735821b1-d052-4f5e-a1ff-e6a5be922d7f" returned: 0 in 0.393s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:44 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4.735821b1-d052-4f5e-a1ff-e6a5be922d7f is being set with open permissions: ugo+rw: NotImplementedError Sep 21 12:00:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4.735821b1-d052-4f5e-a1ff-e6a5be922d7f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:44 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:00:44 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:44 devstack sudo[97346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4.735821b1-d052-4f5e-a1ff-e6a5be922d7f Sep 21 12:00:44 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:44 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7e23a16e-2283-46a5-b2e4-9688271674e0 tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "cinder-cde9e453-5176-4c4d-a516-0df6764a0d6f-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:44 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7e23a16e-2283-46a5-b2e4-9688271674e0 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-cde9e453-5176-4c4d-a516-0df6764a0d6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:44 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7e23a16e-2283-46a5-b2e4-9688271674e0 tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "cinder-quobyte-1156b45b-3e7e-46f2-9301-3496714ae3ed" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:44 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7e23a16e-2283-46a5-b2e4-9688271674e0 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-1156b45b-3e7e-46f2-9301-3496714ae3ed" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:44 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7e23a16e-2283-46a5-b2e4-9688271674e0 tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "cinder-quobyte-cde9e453-5176-4c4d-a516-0df6764a0d6f" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7e23a16e-2283-46a5-b2e4-9688271674e0 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-cde9e453-5176-4c4d-a516-0df6764a0d6f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-7e23a16e-2283-46a5-b2e4-9688271674e0 tempest-VolumesSnapshotTestJSON-402880464 None] Deleting offline snapshot cde9e453-5176-4c4d-a516-0df6764a0d6f of volume 1156b45b-3e7e-46f2-9301-3496714ae3ed {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:00:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-7e23a16e-2283-46a5-b2e4-9688271674e0 tempest-VolumesSnapshotTestJSON-402880464 None] snapshot_file for this snap is: volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.cde9e453-5176-4c4d-a516-0df6764a0d6f {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:00:45 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:45 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26108e2-ef66-4d51-b816-2b063d54ad55]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7e23a16e-2283-46a5-b2e4-9688271674e0 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.cde9e453-5176-4c4d-a516-0df6764a0d6f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6ae036c6-e37f-4f27-8856-d100eae3d6ef tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.385s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:45 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-6ae036c6-e37f-4f27-8856-d100eae3d6ef tempest-VolumesSnapshotTestJSON-402880464 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:00:45 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-6ae036c6-e37f-4f27-8856-d100eae3d6ef tempest-VolumesSnapshotTestJSON-402880464 None] Deleted volume successfully. Sep 21 12:00:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6ae036c6-e37f-4f27-8856-d100eae3d6ef tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-f23f47b9-d156-47d1-9549-2ea076c454e2-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:45 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4.735821b1-d052-4f5e-a1ff-e6a5be922d7f" returned: 0 in 0.453s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:45 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.cde9e453-5176-4c4d-a516-0df6764a0d6f Sep 21 12:00:45 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:45 devstack sudo[97352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4.info Sep 21 12:00:45 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:45 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7e23a16e-2283-46a5-b2e4-9688271674e0 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.cde9e453-5176-4c4d-a516-0df6764a0d6f" returned: 0 in 0.423s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-7e23a16e-2283-46a5-b2e4-9688271674e0 tempest-VolumesSnapshotTestJSON-402880464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1156b45b-3e7e-46f2-9301-3496714ae3ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:00:45 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4.info" returned: 0 in 0.300s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:45 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4.info is being set with open permissions: ugo+rw: NotImplementedError Sep 21 12:00:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:45 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4aac7b-c7eb-40bb-95a9-106e8d5b752f]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7e23a16e-2283-46a5-b2e4-9688271674e0 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:45 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4.info Sep 21 12:00:45 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:45 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed Sep 21 12:00:45 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:45 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4.info" returned: 0 in 0.259s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.647s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] Creating offline snapshot fb2c8010-c15f-4991-88f5-7eabc307204d of volume e3dba329-94c3-4aa0-b62a-a3d14e84a5e7 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:00:45 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6096ff2-3d38-4dde-bde4-6c6e5691c08c]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:45 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7 Sep 21 12:00:45 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:46 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7e23a16e-2283-46a5-b2e4-9688271674e0 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed" returned: 0 in 0.612s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7e23a16e-2283-46a5-b2e4-9688271674e0 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.cde9e453-5176-4c4d-a516-0df6764a0d6f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:46 devstack sudo[97368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.cde9e453-5176-4c4d-a516-0df6764a0d6f Sep 21 12:00:46 devstack sudo[97368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:46 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7" returned: 0 in 0.416s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7.fb2c8010-c15f-4991-88f5-7eabc307204d 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:46 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7.fb2c8010-c15f-4991-88f5-7eabc307204d 1G Sep 21 12:00:46 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:46 devstack sudo[97368]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7e23a16e-2283-46a5-b2e4-9688271674e0 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.cde9e453-5176-4c4d-a516-0df6764a0d6f" returned: 0 in 0.385s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7e23a16e-2283-46a5-b2e4-9688271674e0 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.cde9e453-5176-4c4d-a516-0df6764a0d6f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:46 devstack sudo[97380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.cde9e453-5176-4c4d-a516-0df6764a0d6f Sep 21 12:00:46 devstack sudo[97380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:46 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7.fb2c8010-c15f-4991-88f5-7eabc307204d 1G" returned: 0 in 0.517s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7.fb2c8010-c15f-4991-88f5-7eabc307204d {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:46 devstack sudo[97380]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7e23a16e-2283-46a5-b2e4-9688271674e0 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed.cde9e453-5176-4c4d-a516-0df6764a0d6f" returned: 0 in 0.281s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:46 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7.fb2c8010-c15f-4991-88f5-7eabc307204d Sep 21 12:00:46 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:46 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7e23a16e-2283-46a5-b2e4-9688271674e0 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-cde9e453-5176-4c4d-a516-0df6764a0d6f" released by "_delete_snapshot" :: held 1.880s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:46 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7e23a16e-2283-46a5-b2e4-9688271674e0 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-1156b45b-3e7e-46f2-9301-3496714ae3ed" released by "delete_snapshot" :: held 1.909s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:46 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-7e23a16e-2283-46a5-b2e4-9688271674e0 tempest-VolumesSnapshotTestJSON-402880464 None] Created reservations ['a925eea6-05ec-4a62-8699-8ae861f0b0e0', 'd661c96c-5be5-4586-9659-ea7402eb44a8', 'b8ff8ccb-c3ed-43a4-93e4-c09803fddc3c', '6032ea9c-f014-4dd2-bd31-d32141170703'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:00:47 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-7e23a16e-2283-46a5-b2e4-9688271674e0 tempest-VolumesSnapshotTestJSON-402880464 None] Delete snapshot completed successfully. Sep 21 12:00:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7e23a16e-2283-46a5-b2e4-9688271674e0 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-cde9e453-5176-4c4d-a516-0df6764a0d6f-delete_snapshot" released by "delete_snapshot" :: held 2.113s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0c3f1223-e5bf-4657-8c36-7a0b0337a97e tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "cinder-1156b45b-3e7e-46f2-9301-3496714ae3ed-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:47 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7.fb2c8010-c15f-4991-88f5-7eabc307204d" returned: 0 in 0.435s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:47 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7.fb2c8010-c15f-4991-88f5-7eabc307204d is being set with open permissions: ugo+rw: NotImplementedError Sep 21 12:00:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7.fb2c8010-c15f-4991-88f5-7eabc307204d {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0c3f1223-e5bf-4657-8c36-7a0b0337a97e tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-1156b45b-3e7e-46f2-9301-3496714ae3ed-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:47 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7.fb2c8010-c15f-4991-88f5-7eabc307204d Sep 21 12:00:47 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0c3f1223-e5bf-4657-8c36-7a0b0337a97e tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "cinder-quobyte-1156b45b-3e7e-46f2-9301-3496714ae3ed" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0c3f1223-e5bf-4657-8c36-7a0b0337a97e tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-1156b45b-3e7e-46f2-9301-3496714ae3ed" acquired by "delete_volume" :: waited 0.021s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:47 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[66040d61-64c1-4666-87c2-30f7899d1a25]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0c3f1223-e5bf-4657-8c36-7a0b0337a97e tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:47 devstack sudo[97394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed Sep 21 12:00:47 devstack sudo[97394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:47 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7.fb2c8010-c15f-4991-88f5-7eabc307204d" returned: 0 in 0.307s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:47 devstack sudo[97397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7.info Sep 21 12:00:47 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:47 devstack sudo[97394]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0c3f1223-e5bf-4657-8c36-7a0b0337a97e tempest-VolumesSnapshotTestJSON-402880464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed" returned: 0 in 0.438s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0c3f1223-e5bf-4657-8c36-7a0b0337a97e tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:47 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed Sep 21 12:00:47 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:47 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7.info" returned: 0 in 0.310s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:47 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7.info is being set with open permissions: ugo+rw: NotImplementedError Sep 21 12:00:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:47 devstack sudo[97405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7.info Sep 21 12:00:47 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:48 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0c3f1223-e5bf-4657-8c36-7a0b0337a97e tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1156b45b-3e7e-46f2-9301-3496714ae3ed" returned: 0 in 0.318s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:48 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0c3f1223-e5bf-4657-8c36-7a0b0337a97e tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-1156b45b-3e7e-46f2-9301-3496714ae3ed" released by "delete_volume" :: held 0.845s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:48 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7.info" returned: 0 in 0.311s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.440s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-85494a0a-c3aa-4e17-9841-83d881d6396a tempest-SnapshotsActionsTest-1930914051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.899s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:48 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-85494a0a-c3aa-4e17-9841-83d881d6396a tempest-SnapshotsActionsTest-1930914051 None] Creating offline snapshot 4a95dbaa-530b-4708-a261-0f5194110b30 of volume 5b9f506f-6ddd-485e-bdea-f3f42a527175 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:00:48 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-0c3f1223-e5bf-4657-8c36-7a0b0337a97e tempest-VolumesSnapshotTestJSON-402880464 None] Created reservations ['d4fa0683-d9bf-46db-a93d-061467f111fd', 'a5922476-8b8e-4073-89ac-a08bf3c1d085', '69f201b7-43ff-404b-922f-90014d50a2b6', '01314e2f-b96f-4130-a821-52a3f6f2e22b'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:00:48 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f08fd9-88ae-4d0f-912b-b66630ed7ca0]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-85494a0a-c3aa-4e17-9841-83d881d6396a tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0c3f1223-e5bf-4657-8c36-7a0b0337a97e tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0c3f1223-e5bf-4657-8c36-7a0b0337a97e tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:48 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0c3f1223-e5bf-4657-8c36-7a0b0337a97e tempest-VolumesSnapshotTestJSON-402880464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:00:48 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0c3f1223-e5bf-4657-8c36-7a0b0337a97e tempest-VolumesSnapshotTestJSON-402880464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:00:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0c3f1223-e5bf-4657-8c36-7a0b0337a97e tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0c3f1223-e5bf-4657-8c36-7a0b0337a97e tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:48 devstack sudo[97410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac Sep 21 12:00:48 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:48 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-2655f550-7609-4f6e-abf3-7fb4103113d6 tempest-GroupSnapshotsTest-435114483 None] group_snapshot f4f54669-4d4c-4c9d-9e82-2f14bffd47c6: created successfully Sep 21 12:00:48 devstack sudo[97411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:00:48 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:48 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0c3f1223-e5bf-4657-8c36-7a0b0337a97e tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.276s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:48 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-0c3f1223-e5bf-4657-8c36-7a0b0337a97e tempest-VolumesSnapshotTestJSON-402880464 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:00:48 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-0c3f1223-e5bf-4657-8c36-7a0b0337a97e tempest-VolumesSnapshotTestJSON-402880464 None] Deleted volume successfully. Sep 21 12:00:48 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0c3f1223-e5bf-4657-8c36-7a0b0337a97e tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-1156b45b-3e7e-46f2-9301-3496714ae3ed-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:48 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-85494a0a-c3aa-4e17-9841-83d881d6396a tempest-SnapshotsActionsTest-1930914051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac" returned: 0 in 0.449s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:48 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-85494a0a-c3aa-4e17-9841-83d881d6396a tempest-SnapshotsActionsTest-1930914051 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b9f506f-6ddd-485e-bdea-f3f42a527175(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:00:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-85494a0a-c3aa-4e17-9841-83d881d6396a tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.4a95dbaa-530b-4708-a261-0f5194110b30 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:48 devstack sudo[97421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.4a95dbaa-530b-4708-a261-0f5194110b30 1G Sep 21 12:00:48 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:49 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-85494a0a-c3aa-4e17-9841-83d881d6396a tempest-SnapshotsActionsTest-1930914051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.4a95dbaa-530b-4708-a261-0f5194110b30 1G" returned: 0 in 0.490s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-85494a0a-c3aa-4e17-9841-83d881d6396a tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.4a95dbaa-530b-4708-a261-0f5194110b30 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:49 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.4a95dbaa-530b-4708-a261-0f5194110b30 Sep 21 12:00:49 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:49 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] group_snapshot f4f54669-4d4c-4c9d-9e82-2f14bffd47c6: deleting Sep 21 12:00:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] group_snapshot f4f54669-4d4c-4c9d-9e82-2f14bffd47c6: deleting {{(pid=86366) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 21 12:00:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "cinder-quobyte-b96bbfef-90a0-417c-8e5b-d0856dda33f4" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-b96bbfef-90a0-417c-8e5b-d0856dda33f4" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "cinder-quobyte-735821b1-d052-4f5e-a1ff-e6a5be922d7f" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-735821b1-d052-4f5e-a1ff-e6a5be922d7f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:49 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] Deleting offline snapshot 735821b1-d052-4f5e-a1ff-e6a5be922d7f of volume b96bbfef-90a0-417c-8e5b-d0856dda33f4 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:00:49 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] snapshot_file for this snap is: volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4.735821b1-d052-4f5e-a1ff-e6a5be922d7f {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:00:49 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa2d8d4-97ef-4958-914d-f26fc5ed7d2f]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4.735821b1-d052-4f5e-a1ff-e6a5be922d7f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:49 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-85494a0a-c3aa-4e17-9841-83d881d6396a tempest-SnapshotsActionsTest-1930914051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.4a95dbaa-530b-4708-a261-0f5194110b30" returned: 0 in 0.571s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:49 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-85494a0a-c3aa-4e17-9841-83d881d6396a tempest-SnapshotsActionsTest-1930914051 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.4a95dbaa-530b-4708-a261-0f5194110b30 is being set with open permissions: ugo+rw Sep 21 12:00:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-85494a0a-c3aa-4e17-9841-83d881d6396a tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.4a95dbaa-530b-4708-a261-0f5194110b30 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:50 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.4a95dbaa-530b-4708-a261-0f5194110b30 Sep 21 12:00:50 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:50 devstack sudo[97466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4.735821b1-d052-4f5e-a1ff-e6a5be922d7f Sep 21 12:00:50 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:50 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:00:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Flow 'volume_create_manager' (05c2172d-aade-45ed-802b-ea2016023c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:00:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca2ae7ea-3a84-4d3b-aa34-c9b4233be6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca2ae7ea-3a84-4d3b-aa34-c9b4233be6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-886013385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2a0d455-6f24-48d5-965f-a4c34e3c10b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b1164abba474a0283c76823e39bcc98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:00:50Z,use_quota=True,user_id='dca8aea142684429b349a15ce64100c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eb4ee74-2c37-435d-83e0-49d7b5349537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:50 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eb4ee74-2c37-435d-83e0-49d7b5349537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8911f42-955a-413a-b88d-5b73d2231c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8911f42-955a-413a-b88d-5b73d2231c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2a0d455-6f24-48d5-965f-a4c34e3c10b0', 'volume_name': 'volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ad8de9-5779-4ed2-8e35-4bc1afd498ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ad8de9-5779-4ed2-8e35-4bc1afd498ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b11c46b0-a271-461b-bc62-179d0e2ad69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:50 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Volume c2a0d455-6f24-48d5-965f-a4c34e3c10b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0', 'volume_size': 1} Sep 21 12:00:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-85494a0a-c3aa-4e17-9841-83d881d6396a tempest-SnapshotsActionsTest-1930914051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.4a95dbaa-530b-4708-a261-0f5194110b30" returned: 0 in 0.495s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:50 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4.735821b1-d052-4f5e-a1ff-e6a5be922d7f" returned: 0 in 0.574s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:50 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:00:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-85494a0a-c3aa-4e17-9841-83d881d6396a tempest-SnapshotsActionsTest-1930914051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.286s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:50 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7bd095-d428-4325-849d-c873259caa17]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.068s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:50 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-886013385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2a0d455-6f24-48d5-965f-a4c34e3c10b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b1164abba474a0283c76823e39bcc98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:00:50Z,use_quota=True,user_id='dca8aea142684429b349a15ce64100c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:00:50 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Creating volume c2a0d455-6f24-48d5-965f-a4c34e3c10b0 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:00:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:50 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:00:50 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:00:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:50 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:00:50 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:00:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:50 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0 1073741824 Sep 21 12:00:50 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:50 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-85494a0a-c3aa-4e17-9841-83d881d6396a tempest-SnapshotsActionsTest-1930914051 None] Create snapshot completed successfully Sep 21 12:00:50 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4 Sep 21 12:00:50 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:51 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4" returned: 0 in 0.443s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4.735821b1-d052-4f5e-a1ff-e6a5be922d7f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:51 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4.735821b1-d052-4f5e-a1ff-e6a5be922d7f Sep 21 12:00:51 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:51 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0 1073741824" returned: 0 in 0.585s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:51 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0 Sep 21 12:00:51 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-76714908-3cd7-4149-b4aa-f35918428bd7 tempest-SnapshotsActionsTest-1132121926 None] Acquiring lock "cinder-4a95dbaa-530b-4708-a261-0f5194110b30-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-76714908-3cd7-4149-b4aa-f35918428bd7 tempest-SnapshotsActionsTest-1132121926 None] Lock "cinder-4a95dbaa-530b-4708-a261-0f5194110b30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-76714908-3cd7-4149-b4aa-f35918428bd7 tempest-SnapshotsActionsTest-1132121926 None] Acquiring lock "cinder-quobyte-5b9f506f-6ddd-485e-bdea-f3f42a527175" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-76714908-3cd7-4149-b4aa-f35918428bd7 tempest-SnapshotsActionsTest-1132121926 None] Lock "cinder-quobyte-5b9f506f-6ddd-485e-bdea-f3f42a527175" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-76714908-3cd7-4149-b4aa-f35918428bd7 tempest-SnapshotsActionsTest-1132121926 None] Acquiring lock "cinder-quobyte-4a95dbaa-530b-4708-a261-0f5194110b30" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-76714908-3cd7-4149-b4aa-f35918428bd7 tempest-SnapshotsActionsTest-1132121926 None] Lock "cinder-quobyte-4a95dbaa-530b-4708-a261-0f5194110b30" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-76714908-3cd7-4149-b4aa-f35918428bd7 tempest-SnapshotsActionsTest-1132121926 None] Deleting offline snapshot 4a95dbaa-530b-4708-a261-0f5194110b30 of volume 5b9f506f-6ddd-485e-bdea-f3f42a527175 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-76714908-3cd7-4149-b4aa-f35918428bd7 tempest-SnapshotsActionsTest-1132121926 None] snapshot_file for this snap is: volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.4a95dbaa-530b-4708-a261-0f5194110b30 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34ae7c8-4bbe-484b-981d-ab1e9bf6e270]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-76714908-3cd7-4149-b4aa-f35918428bd7 tempest-SnapshotsActionsTest-1132121926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.4a95dbaa-530b-4708-a261-0f5194110b30 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:51 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4.735821b1-d052-4f5e-a1ff-e6a5be922d7f" returned: 0 in 0.517s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4.735821b1-d052-4f5e-a1ff-e6a5be922d7f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:51 devstack sudo[97497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4.735821b1-d052-4f5e-a1ff-e6a5be922d7f Sep 21 12:00:51 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:51 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0" returned: 0 in 0.389s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b11c46b0-a271-461b-bc62-179d0e2ad69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (608a396b-fb6f-40f8-8090-c4ebf6e6bb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:51 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Volume volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0 (c2a0d455-6f24-48d5-965f-a4c34e3c10b0): created successfully Sep 21 12:00:51 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.4a95dbaa-530b-4708-a261-0f5194110b30 Sep 21 12:00:51 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (608a396b-fb6f-40f8-8090-c4ebf6e6bb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Flow 'volume_create_manager' (05c2172d-aade-45ed-802b-ea2016023c4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:00:51 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-106bbd11-1c04-458e-9135-2c1f8b1c158c tempest-VolumesSnapshotTestJSON-402880464 None] Created volume successfully. Sep 21 12:00:51 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4.735821b1-d052-4f5e-a1ff-e6a5be922d7f" returned: 0 in 0.351s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-735821b1-d052-4f5e-a1ff-e6a5be922d7f" released by "_delete_snapshot" :: held 2.081s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-b96bbfef-90a0-417c-8e5b-d0856dda33f4" released by "delete_snapshot" :: held 2.119s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "cinder-quobyte-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "cinder-quobyte-fb2c8010-c15f-4991-88f5-7eabc307204d" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-fb2c8010-c15f-4991-88f5-7eabc307204d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:51 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] Deleting offline snapshot fb2c8010-c15f-4991-88f5-7eabc307204d of volume e3dba329-94c3-4aa0-b62a-a3d14e84a5e7 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:00:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] snapshot_file for this snap is: volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7.fb2c8010-c15f-4991-88f5-7eabc307204d {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:00:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-76714908-3cd7-4149-b4aa-f35918428bd7 tempest-SnapshotsActionsTest-1132121926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.4a95dbaa-530b-4708-a261-0f5194110b30" returned: 0 in 0.501s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-76714908-3cd7-4149-b4aa-f35918428bd7 tempest-SnapshotsActionsTest-1132121926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b9f506f-6ddd-485e-bdea-f3f42a527175(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:00:52 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[896bae52-f0dd-4b17-9c48-5f60859a1a7f]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7.fb2c8010-c15f-4991-88f5-7eabc307204d {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:52 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[98643a51-fbec-4cd8-b21e-f7a70b1bdbbb]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-76714908-3cd7-4149-b4aa-f35918428bd7 tempest-SnapshotsActionsTest-1132121926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:52 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3577591d-ba67-45cc-9af2-06ce2a50cb57 tempest-VolumesNegativeTest-485086136 None] Acquiring lock "cinder-b5ed6bc7-a7be-4d73-9523-1d48d8221542-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:52 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3577591d-ba67-45cc-9af2-06ce2a50cb57 tempest-VolumesNegativeTest-485086136 None] Lock "cinder-b5ed6bc7-a7be-4d73-9523-1d48d8221542-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:52 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3577591d-ba67-45cc-9af2-06ce2a50cb57 tempest-VolumesNegativeTest-485086136 None] Acquiring lock "cinder-quobyte-b5ed6bc7-a7be-4d73-9523-1d48d8221542" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:52 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3577591d-ba67-45cc-9af2-06ce2a50cb57 tempest-VolumesNegativeTest-485086136 None] Lock "cinder-quobyte-b5ed6bc7-a7be-4d73-9523-1d48d8221542" acquired by "delete_volume" :: waited 0.017s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:52 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7.fb2c8010-c15f-4991-88f5-7eabc307204d Sep 21 12:00:52 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:52 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08519e6-ef49-431b-8f54-f889ba958bd1]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3577591d-ba67-45cc-9af2-06ce2a50cb57 tempest-VolumesNegativeTest-485086136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b5ed6bc7-a7be-4d73-9523-1d48d8221542 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:52 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac Sep 21 12:00:52 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:52 devstack sudo[97507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b5ed6bc7-a7be-4d73-9523-1d48d8221542 Sep 21 12:00:52 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:52 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7.fb2c8010-c15f-4991-88f5-7eabc307204d" returned: 0 in 0.481s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:00:52 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-76714908-3cd7-4149-b4aa-f35918428bd7 tempest-SnapshotsActionsTest-1132121926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac" returned: 0 in 0.514s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-76714908-3cd7-4149-b4aa-f35918428bd7 tempest-SnapshotsActionsTest-1132121926 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b9f506f-6ddd-485e-bdea-f3f42a527175(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:00:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-76714908-3cd7-4149-b4aa-f35918428bd7 tempest-SnapshotsActionsTest-1132121926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.4a95dbaa-530b-4708-a261-0f5194110b30 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:52 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7e05bb-aed9-4f4d-b775-ac2dbdd07bb1]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:52 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.4a95dbaa-530b-4708-a261-0f5194110b30 Sep 21 12:00:52 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-dccf419d-930e-4367-a34a-6ef83df81cc6 tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-dccf419d-930e-4367-a34a-6ef83df81cc6 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-dccf419d-930e-4367-a34a-6ef83df81cc6 tempest-VolumesSnapshotTestJSON-402880464 None] Creating offline snapshot e0bd9bca-159d-4044-a826-c018559bd0ed of volume c2a0d455-6f24-48d5-965f-a4c34e3c10b0 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:00:52 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3577591d-ba67-45cc-9af2-06ce2a50cb57 tempest-VolumesNegativeTest-485086136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b5ed6bc7-a7be-4d73-9523-1d48d8221542" returned: 0 in 0.508s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3577591d-ba67-45cc-9af2-06ce2a50cb57 tempest-VolumesNegativeTest-485086136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b5ed6bc7-a7be-4d73-9523-1d48d8221542 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:52 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd89a76-b84a-4d0c-b989-997eb32060fa]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dccf419d-930e-4367-a34a-6ef83df81cc6 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:52 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7 Sep 21 12:00:52 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:52 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b5ed6bc7-a7be-4d73-9523-1d48d8221542 Sep 21 12:00:52 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:52 devstack sudo[97525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0 Sep 21 12:00:52 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:53 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3577591d-ba67-45cc-9af2-06ce2a50cb57 tempest-VolumesNegativeTest-485086136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b5ed6bc7-a7be-4d73-9523-1d48d8221542" returned: 0 in 0.295s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3577591d-ba67-45cc-9af2-06ce2a50cb57 tempest-VolumesNegativeTest-485086136 None] Lock "cinder-quobyte-b5ed6bc7-a7be-4d73-9523-1d48d8221542" released by "delete_volume" :: held 0.869s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:53 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7" returned: 0 in 0.463s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:53 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7.fb2c8010-c15f-4991-88f5-7eabc307204d {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-76714908-3cd7-4149-b4aa-f35918428bd7 tempest-SnapshotsActionsTest-1132121926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.4a95dbaa-530b-4708-a261-0f5194110b30" returned: 0 in 0.493s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-76714908-3cd7-4149-b4aa-f35918428bd7 tempest-SnapshotsActionsTest-1132121926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.4a95dbaa-530b-4708-a261-0f5194110b30 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:53 devstack sudo[97535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7.fb2c8010-c15f-4991-88f5-7eabc307204d Sep 21 12:00:53 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:53 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.4a95dbaa-530b-4708-a261-0f5194110b30 Sep 21 12:00:53 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:53 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-3577591d-ba67-45cc-9af2-06ce2a50cb57 tempest-VolumesNegativeTest-485086136 None] Created reservations ['49604c71-d6ae-40e1-9b0d-a498b4ccab25', '2caffe0c-03c4-452f-a4f1-a7d40c60938a', 'fea39e4b-fdbc-4525-ac6d-cd21c0a1b0ab', '71472aaf-e611-46e5-b508-a59bc13a6646'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:00:53 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dccf419d-930e-4367-a34a-6ef83df81cc6 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0" returned: 0 in 0.546s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dccf419d-930e-4367-a34a-6ef83df81cc6 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.e0bd9bca-159d-4044-a826-c018559bd0ed 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3577591d-ba67-45cc-9af2-06ce2a50cb57 tempest-VolumesNegativeTest-485086136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3577591d-ba67-45cc-9af2-06ce2a50cb57 tempest-VolumesNegativeTest-485086136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:53 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3577591d-ba67-45cc-9af2-06ce2a50cb57 tempest-VolumesNegativeTest-485086136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:00:53 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3577591d-ba67-45cc-9af2-06ce2a50cb57 tempest-VolumesNegativeTest-485086136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:00:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3577591d-ba67-45cc-9af2-06ce2a50cb57 tempest-VolumesNegativeTest-485086136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:53 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.e0bd9bca-159d-4044-a826-c018559bd0ed 1G Sep 21 12:00:53 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3577591d-ba67-45cc-9af2-06ce2a50cb57 tempest-VolumesNegativeTest-485086136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:53 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:00:53 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:53 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-76714908-3cd7-4149-b4aa-f35918428bd7 tempest-SnapshotsActionsTest-1132121926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.4a95dbaa-530b-4708-a261-0f5194110b30" returned: 0 in 0.503s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-76714908-3cd7-4149-b4aa-f35918428bd7 tempest-SnapshotsActionsTest-1132121926 None] Lock "cinder-quobyte-4a95dbaa-530b-4708-a261-0f5194110b30" released by "_delete_snapshot" :: held 2.173s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-76714908-3cd7-4149-b4aa-f35918428bd7 tempest-SnapshotsActionsTest-1132121926 None] Lock "cinder-quobyte-5b9f506f-6ddd-485e-bdea-f3f42a527175" released by "delete_snapshot" :: held 2.211s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:53 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7.fb2c8010-c15f-4991-88f5-7eabc307204d" returned: 0 in 0.617s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7.fb2c8010-c15f-4991-88f5-7eabc307204d {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:53 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7.fb2c8010-c15f-4991-88f5-7eabc307204d Sep 21 12:00:53 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:53 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3577591d-ba67-45cc-9af2-06ce2a50cb57 tempest-VolumesNegativeTest-485086136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.414s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:53 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-3577591d-ba67-45cc-9af2-06ce2a50cb57 tempest-VolumesNegativeTest-485086136 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:00:53 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-3577591d-ba67-45cc-9af2-06ce2a50cb57 tempest-VolumesNegativeTest-485086136 None] Deleted volume successfully. Sep 21 12:00:53 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-76714908-3cd7-4149-b4aa-f35918428bd7 tempest-SnapshotsActionsTest-1132121926 None] Created reservations ['bd589a92-5cac-4e64-8604-6b2d92537c2b', '55454478-a411-4408-af4d-9fb7e7abffc5', '986916f5-8b1d-4c0b-b5de-a2598b02c33f', 'd0d31111-7cd4-460a-9825-8471b9b78765'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:00:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3577591d-ba67-45cc-9af2-06ce2a50cb57 tempest-VolumesNegativeTest-485086136 None] Lock "cinder-b5ed6bc7-a7be-4d73-9523-1d48d8221542-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:53 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-76714908-3cd7-4149-b4aa-f35918428bd7 tempest-SnapshotsActionsTest-1132121926 None] Delete snapshot completed successfully. Sep 21 12:00:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-76714908-3cd7-4149-b4aa-f35918428bd7 tempest-SnapshotsActionsTest-1132121926 None] Lock "cinder-4a95dbaa-530b-4708-a261-0f5194110b30-delete_snapshot" released by "delete_snapshot" :: held 2.478s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:53 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dccf419d-930e-4367-a34a-6ef83df81cc6 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.e0bd9bca-159d-4044-a826-c018559bd0ed 1G" returned: 0 in 0.674s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dccf419d-930e-4367-a34a-6ef83df81cc6 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.e0bd9bca-159d-4044-a826-c018559bd0ed {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:53 devstack sudo[97560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.e0bd9bca-159d-4044-a826-c018559bd0ed Sep 21 12:00:53 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:54 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7.fb2c8010-c15f-4991-88f5-7eabc307204d" returned: 0 in 0.393s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-fb2c8010-c15f-4991-88f5-7eabc307204d" released by "_delete_snapshot" :: held 2.144s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7" released by "delete_snapshot" :: held 2.174s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:54 devstack cinder-volume[86366]: WARNING cinder.quota [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-965436806 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-965436806, it is now deprecated. Please use the default quota class for default quota. Sep 21 12:00:54 devstack cinder-volume[86366]: WARNING cinder.quota [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-965436806 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-965436806, it is now deprecated. Please use the default quota class for default quota. Sep 21 12:00:54 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] Created reservations ['f7c3920a-af42-4954-9a0f-eb731d8e1e90', '85bfef6c-b76f-4506-8e9c-5f23ea961a05', '4d1376c6-da31-4411-a903-1a4aaed1cb4d', 'cf84455e-8b00-497e-826e-d108238b6cc9'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:00:54 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dccf419d-930e-4367-a34a-6ef83df81cc6 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.e0bd9bca-159d-4044-a826-c018559bd0ed" returned: 0 in 0.411s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:54 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-dccf419d-930e-4367-a34a-6ef83df81cc6 tempest-VolumesSnapshotTestJSON-402880464 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.e0bd9bca-159d-4044-a826-c018559bd0ed is being set with open permissions: ugo+rw Sep 21 12:00:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dccf419d-930e-4367-a34a-6ef83df81cc6 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.e0bd9bca-159d-4044-a826-c018559bd0ed {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:54 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.e0bd9bca-159d-4044-a826-c018559bd0ed Sep 21 12:00:54 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:54 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] Created reservations ['5e987349-3d7b-4071-917c-13e82b7b7b50', 'ff9a6e49-09bd-4e9d-86cf-164fcb6eabb8', '4b53a98b-e18e-489d-9bf3-092321b1181e', 'a7260e29-491c-4939-b285-81e956db8b2f'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:00:54 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-5afa9497-4e20-4fe7-83e7-a6d74f79b4d8 tempest-GroupSnapshotsTest-435114483 None] group_snapshot f4f54669-4d4c-4c9d-9e82-2f14bffd47c6: deleted successfully Sep 21 12:00:54 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dccf419d-930e-4367-a34a-6ef83df81cc6 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.e0bd9bca-159d-4044-a826-c018559bd0ed" returned: 0 in 0.345s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dccf419d-930e-4367-a34a-6ef83df81cc6 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:54 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.info Sep 21 12:00:54 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-edb7b15e-87e5-4259-bca7-dbb28733c9f9 tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "cinder-quobyte-b96bbfef-90a0-417c-8e5b-d0856dda33f4" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:55 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-94a9bc0e-aea7-47f8-b113-623438afc203 tempest-SnapshotsActionsTest-1930914051 None] Acquiring lock "cinder-7cf9af08-c330-4e55-b5f6-c24ef96748ac-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dccf419d-930e-4367-a34a-6ef83df81cc6 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.info" returned: 0 in 0.410s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:55 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-dccf419d-930e-4367-a34a-6ef83df81cc6 tempest-VolumesSnapshotTestJSON-402880464 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.info is being set with open permissions: ugo+rw Sep 21 12:00:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dccf419d-930e-4367-a34a-6ef83df81cc6 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-edb7b15e-87e5-4259-bca7-dbb28733c9f9 tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-b96bbfef-90a0-417c-8e5b-d0856dda33f4" acquired by "delete_volume" :: waited 0.051s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:55 devstack sudo[97572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.info Sep 21 12:00:55 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-94a9bc0e-aea7-47f8-b113-623438afc203 tempest-SnapshotsActionsTest-1930914051 None] Lock "cinder-7cf9af08-c330-4e55-b5f6-c24ef96748ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.103s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-94a9bc0e-aea7-47f8-b113-623438afc203 tempest-SnapshotsActionsTest-1930914051 None] Acquiring lock "cinder-quobyte-5b9f506f-6ddd-485e-bdea-f3f42a527175" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:55 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f775ee6-f67c-4380-822d-d27a0b85f26d]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-edb7b15e-87e5-4259-bca7-dbb28733c9f9 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-94a9bc0e-aea7-47f8-b113-623438afc203 tempest-SnapshotsActionsTest-1930914051 None] Lock "cinder-quobyte-5b9f506f-6ddd-485e-bdea-f3f42a527175" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-94a9bc0e-aea7-47f8-b113-623438afc203 tempest-SnapshotsActionsTest-1930914051 None] Acquiring lock "cinder-quobyte-7cf9af08-c330-4e55-b5f6-c24ef96748ac" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-94a9bc0e-aea7-47f8-b113-623438afc203 tempest-SnapshotsActionsTest-1930914051 None] Lock "cinder-quobyte-7cf9af08-c330-4e55-b5f6-c24ef96748ac" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:55 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-94a9bc0e-aea7-47f8-b113-623438afc203 tempest-SnapshotsActionsTest-1930914051 None] Deleting offline snapshot 7cf9af08-c330-4e55-b5f6-c24ef96748ac of volume 5b9f506f-6ddd-485e-bdea-f3f42a527175 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:00:55 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-94a9bc0e-aea7-47f8-b113-623438afc203 tempest-SnapshotsActionsTest-1930914051 None] snapshot_file for this snap is: volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:00:55 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c55f0d1-8c48-4a90-a2d0-33adec8f1ad4]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-94a9bc0e-aea7-47f8-b113-623438afc203 tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:55 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dccf419d-930e-4367-a34a-6ef83df81cc6 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.info" returned: 0 in 0.289s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:55 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4 Sep 21 12:00:55 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-dccf419d-930e-4367-a34a-6ef83df81cc6 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.812s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:55 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-dccf419d-930e-4367-a34a-6ef83df81cc6 tempest-VolumesSnapshotTestJSON-402880464 None] Create snapshot completed successfully Sep 21 12:00:55 devstack sudo[97576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac Sep 21 12:00:55 devstack sudo[97576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:55 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-edb7b15e-87e5-4259-bca7-dbb28733c9f9 tempest-GroupSnapshotsTest-435114483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4" returned: 0 in 0.515s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-edb7b15e-87e5-4259-bca7-dbb28733c9f9 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:55 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4 Sep 21 12:00:55 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:55 devstack sudo[97576]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-94a9bc0e-aea7-47f8-b113-623438afc203 tempest-SnapshotsActionsTest-1930914051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac" returned: 0 in 0.478s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:55 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-94a9bc0e-aea7-47f8-b113-623438afc203 tempest-SnapshotsActionsTest-1930914051 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b9f506f-6ddd-485e-bdea-f3f42a527175(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:00:55 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b31f3f-fc64-4f37-827b-9185658d745d]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-94a9bc0e-aea7-47f8-b113-623438afc203 tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:56 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-edb7b15e-87e5-4259-bca7-dbb28733c9f9 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b96bbfef-90a0-417c-8e5b-d0856dda33f4" returned: 0 in 0.295s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:56 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175 Sep 21 12:00:56 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-edb7b15e-87e5-4259-bca7-dbb28733c9f9 tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-b96bbfef-90a0-417c-8e5b-d0856dda33f4" released by "delete_volume" :: held 0.943s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-edb7b15e-87e5-4259-bca7-dbb28733c9f9 tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "cinder-quobyte-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-edb7b15e-87e5-4259-bca7-dbb28733c9f9 tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7" acquired by "delete_volume" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c52f946-8a2c-4bfd-9378-177c497b27b0]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-edb7b15e-87e5-4259-bca7-dbb28733c9f9 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:56 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7 Sep 21 12:00:56 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:56 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-94a9bc0e-aea7-47f8-b113-623438afc203 tempest-SnapshotsActionsTest-1930914051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175" returned: 0 in 0.592s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-94a9bc0e-aea7-47f8-b113-623438afc203 tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:56 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac Sep 21 12:00:56 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Flow 'volume_create_manager' (472f4549-c591-428d-8bea-4bcf669b561d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2d1eb11-0bec-4e28-a566-e6f0c4cd9abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2d1eb11-0bec-4e28-a566-e6f0c4cd9abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1185554405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd0f7d6-2e43-44e1-aa4b-0589301d1775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b1164abba474a0283c76823e39bcc98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e0bd9bca-159d-4044-a826-c018559bd0ed,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:00:57Z,use_quota=True,user_id='dca8aea142684429b349a15ce64100c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea558c95-8a3d-424e-be66-a88a129f455c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea558c95-8a3d-424e-be66-a88a129f455c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70540d2c-cad2-43b2-96d0-ee5d302f3c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70540d2c-cad2-43b2-96d0-ee5d302f3c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5cd0f7d6-2e43-44e1-aa4b-0589301d1775', 'volume_name': 'volume-5cd0f7d6-2e43-44e1-aa4b-0589301d1775', 'volume_size': 1, 'snapshot_id': 'e0bd9bca-159d-4044-a826-c018559bd0ed'}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86e1cf83-5576-4ef0-bac2-29db5f5175a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86e1cf83-5576-4ef0-bac2-29db5f5175a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c924d0df-85f7-4e91-8574-98fdd936b89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:56 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Volume 5cd0f7d6-2e43-44e1-aa4b-0589301d1775: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5cd0f7d6-2e43-44e1-aa4b-0589301d1775', 'volume_size': 1, 'snapshot_id': 'e0bd9bca-159d-4044-a826-c018559bd0ed'} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "cinder-quobyte-e0bd9bca-159d-4044-a826-c018559bd0ed-5cd0f7d6-2e43-44e1-aa4b-0589301d1775" by "_create_volume_from_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-e0bd9bca-159d-4044-a826-c018559bd0ed-5cd0f7d6-2e43-44e1-aa4b-0589301d1775" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Creating volume 5cd0f7d6-2e43-44e1-aa4b-0589301d1775 from snapshot e0bd9bca-159d-4044-a826-c018559bd0ed {{(pid=86366) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "cinder-quobyte-5cd0f7d6-2e43-44e1-aa4b-0589301d1775" by "_copy_volume_from_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:56 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-edb7b15e-87e5-4259-bca7-dbb28733c9f9 tempest-GroupSnapshotsTest-435114483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7" returned: 0 in 0.534s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-edb7b15e-87e5-4259-bca7-dbb28733c9f9 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-5cd0f7d6-2e43-44e1-aa4b-0589301d1775" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] snapshot: e0bd9bca-159d-4044-a826-c018559bd0ed, volume: 5cd0f7d6-2e43-44e1-aa4b-0589301d1775, {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 21 12:00:56 devstack sudo[97600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7 Sep 21 12:00:56 devstack sudo[97600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c00dd9f-4ff7-4d6b-b9cc-74369b2d2f46]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.e0bd9bca-159d-4044-a826-c018559bd0ed {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:57 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-94a9bc0e-aea7-47f8-b113-623438afc203 tempest-SnapshotsActionsTest-1930914051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac" returned: 0 in 0.502s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-94a9bc0e-aea7-47f8-b113-623438afc203 tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:57 devstack sudo[97604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.e0bd9bca-159d-4044-a826-c018559bd0ed Sep 21 12:00:57 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:57 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac Sep 21 12:00:57 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:57 devstack sudo[97600]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-edb7b15e-87e5-4259-bca7-dbb28733c9f9 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7" returned: 0 in 0.365s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:57 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-edb7b15e-87e5-4259-bca7-dbb28733c9f9 tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-e3dba329-94c3-4aa0-b62a-a3d14e84a5e7" released by "delete_volume" :: held 1.004s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:57 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-edb7b15e-87e5-4259-bca7-dbb28733c9f9 tempest-GroupSnapshotsTest-435114483 None] Created reservations ['a69d64e7-241f-4e6e-97f3-97d465fe2dbf'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:00:57 devstack cinder-volume[86366]: WARNING cinder.quota [None req-edb7b15e-87e5-4259-bca7-dbb28733c9f9 tempest-GroupSnapshotsTest-435114483 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-965436806 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-965436806, it is now deprecated. Please use the default quota class for default quota. Sep 21 12:00:57 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-edb7b15e-87e5-4259-bca7-dbb28733c9f9 tempest-GroupSnapshotsTest-435114483 None] Created reservations ['9b68a1ea-c59b-47d3-a14d-aa4c64f06a21', '1da25962-3ed1-4406-a1a4-b014cb64e95b', '30fb8f7c-9e04-4c66-813b-822b2bfe23dd', 'f5cb458c-3a55-4f27-9a4d-691e7fc47163'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:00:57 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-94a9bc0e-aea7-47f8-b113-623438afc203 tempest-SnapshotsActionsTest-1930914051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175.7cf9af08-c330-4e55-b5f6-c24ef96748ac" returned: 0 in 0.307s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:57 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.e0bd9bca-159d-4044-a826-c018559bd0ed" returned: 0 in 0.524s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:00:57 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-94a9bc0e-aea7-47f8-b113-623438afc203 tempest-SnapshotsActionsTest-1930914051 None] Lock "cinder-quobyte-7cf9af08-c330-4e55-b5f6-c24ef96748ac" released by "_delete_snapshot" :: held 2.061s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:57 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-94a9bc0e-aea7-47f8-b113-623438afc203 tempest-SnapshotsActionsTest-1930914051 None] Lock "cinder-quobyte-5b9f506f-6ddd-485e-bdea-f3f42a527175" released by "delete_snapshot" :: held 2.122s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:57 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb958f1e-be11-4b7d-84d8-bd6cc192917b]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:57 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-94a9bc0e-aea7-47f8-b113-623438afc203 tempest-SnapshotsActionsTest-1930914051 None] Created reservations ['2156a812-4557-4676-9bb9-a105bc8ab4ce', '64b7671d-c9a2-458b-a5b4-467b1315a44e', '8fba4815-fb90-4e81-b43e-ef3cb5d6b43f', '47d6cf50-a0a0-4471-85c1-c75566d1a7b7'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:00:57 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-edb7b15e-87e5-4259-bca7-dbb28733c9f9 tempest-GroupSnapshotsTest-435114483 None] Created reservations ['f569ccca-6a19-421a-b405-7d79a8812dce', '542d4153-3b0c-4500-94b9-cd6de67fbfd1', 'b7f513a5-c3f1-4be7-b03e-dd6ed989bb2f', '747886a2-5746-469f-a361-41643a1d36de'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:00:57 devstack sudo[97614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0 Sep 21 12:00:57 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:57 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-94a9bc0e-aea7-47f8-b113-623438afc203 tempest-SnapshotsActionsTest-1930914051 None] Delete snapshot completed successfully. Sep 21 12:00:57 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-94a9bc0e-aea7-47f8-b113-623438afc203 tempest-SnapshotsActionsTest-1930914051 None] Lock "cinder-7cf9af08-c330-4e55-b5f6-c24ef96748ac-delete_snapshot" released by "delete_snapshot" :: held 2.456s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:00:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-edb7b15e-87e5-4259-bca7-dbb28733c9f9 tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-edb7b15e-87e5-4259-bca7-dbb28733c9f9 tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:00:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-edb7b15e-87e5-4259-bca7-dbb28733c9f9 tempest-GroupSnapshotsTest-435114483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:00:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-edb7b15e-87e5-4259-bca7-dbb28733c9f9 tempest-GroupSnapshotsTest-435114483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:00:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-edb7b15e-87e5-4259-bca7-dbb28733c9f9 tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:00:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-edb7b15e-87e5-4259-bca7-dbb28733c9f9 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:57 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:00:57 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:57 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0" returned: 0 in 0.499s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0 {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 21 12:00:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Creating direct copy from snapshot {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 21 12:00:57 devstack cinder-volume[86366]: DEBUG cinder.utils [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Path /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5cd0f7d6-2e43-44e1-aa4b-0589301d1775 not found in is_blk_device check {{(pid=86366) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 21 12:00:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5cd0f7d6-2e43-44e1-aa4b-0589301d1775 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:57 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5cd0f7d6-2e43-44e1-aa4b-0589301d1775 Sep 21 12:00:58 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:58 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-edb7b15e-87e5-4259-bca7-dbb28733c9f9 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.294s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:58 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-edb7b15e-87e5-4259-bca7-dbb28733c9f9 tempest-GroupSnapshotsTest-435114483 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:00:58 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-edb7b15e-87e5-4259-bca7-dbb28733c9f9 tempest-GroupSnapshotsTest-435114483 None] Delete group completed successfully. Sep 21 12:00:58 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:00:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Flow 'volume_create_manager' (25913888-c76e-4eec-939b-df4147eb4e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:00:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c9ee2b-3152-474c-8901-002c6da26728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c9ee2b-3152-474c-8901-002c6da26728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1961992950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ca5f1e6-8657-460b-baa9-b50764e6f6cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97b6ec2addd49c6978bc901dafa278d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:00:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:00:58Z,use_quota=True,user_id='7a6dfa264dd94539917a90c675ac534c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f63604a-ed15-4385-ba30-92c4c12d6b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f63604a-ed15-4385-ba30-92c4c12d6b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff6c1cf-1264-42aa-86bc-717909d1736a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff6c1cf-1264-42aa-86bc-717909d1736a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ca5f1e6-8657-460b-baa9-b50764e6f6cf', 'volume_name': 'volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf', 'volume_size': 2}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79c7914-9103-43bf-90c0-a653adfe4d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79c7914-9103-43bf-90c0-a653adfe4d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:00:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e20f707d-8f30-4663-ae38-1285018b11df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:00:58 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Volume 2ca5f1e6-8657-460b-baa9-b50764e6f6cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf', 'volume_size': 2} Sep 21 12:00:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:00:58 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1f54e99a-085b-4a72-8ea3-aeda5be59cec tempest-SnapshotsActionsTest-1930914051 None] Acquiring lock "cinder-5b9f506f-6ddd-485e-bdea-f3f42a527175-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:58 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1f54e99a-085b-4a72-8ea3-aeda5be59cec tempest-SnapshotsActionsTest-1930914051 None] Lock "cinder-5b9f506f-6ddd-485e-bdea-f3f42a527175-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:58 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1f54e99a-085b-4a72-8ea3-aeda5be59cec tempest-SnapshotsActionsTest-1930914051 None] Acquiring lock "cinder-quobyte-5b9f506f-6ddd-485e-bdea-f3f42a527175" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:00:58 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1f54e99a-085b-4a72-8ea3-aeda5be59cec tempest-SnapshotsActionsTest-1930914051 None] Lock "cinder-quobyte-5b9f506f-6ddd-485e-bdea-f3f42a527175" acquired by "delete_volume" :: waited 0.024s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:00:58 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef22a28a-f9f8-49e1-acc7-3615e1a848ed]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:00:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f54e99a-085b-4a72-8ea3-aeda5be59cec tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:58 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175 Sep 21 12:00:58 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:59 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-da69a511-f2a0-435e-8450-bd5ab4aee2e8 tempest-GroupSnapshotsTest-435114483 None] Group tempest-GroupSnapshotsTest-Group-166041546: creating Sep 21 12:00:59 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:59 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-da69a511-f2a0-435e-8450-bd5ab4aee2e8 tempest-GroupSnapshotsTest-435114483 None] Group tempest-GroupSnapshotsTest-Group-166041546: created successfully Sep 21 12:00:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f54e99a-085b-4a72-8ea3-aeda5be59cec tempest-SnapshotsActionsTest-1930914051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175" returned: 0 in 0.896s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:00:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f54e99a-085b-4a72-8ea3-aeda5be59cec tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:00:59 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-da69a511-f2a0-435e-8450-bd5ab4aee2e8 tempest-GroupSnapshotsTest-435114483 None] Create group completed successfully. Sep 21 12:00:59 devstack sudo[97647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175 Sep 21 12:00:59 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:00:59 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root Sep 21 12:00:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f54e99a-085b-4a72-8ea3-aeda5be59cec tempest-SnapshotsActionsTest-1930914051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5b9f506f-6ddd-485e-bdea-f3f42a527175" returned: 0 in 0.372s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:00 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1f54e99a-085b-4a72-8ea3-aeda5be59cec tempest-SnapshotsActionsTest-1930914051 None] Lock "cinder-quobyte-5b9f506f-6ddd-485e-bdea-f3f42a527175" released by "delete_volume" :: held 1.409s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:01:00 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-1f54e99a-085b-4a72-8ea3-aeda5be59cec tempest-SnapshotsActionsTest-1930914051 None] Created reservations ['5517da89-fdaa-47cc-bb2b-e8cb6c90d439', '3c043805-4687-4881-a915-71b8cfa11d0d', '75ae34c1-2ef2-432d-aa88-986db333ce87', 'e714cf12-0540-404f-bada-e83e1a33b8ce'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:01:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1f54e99a-085b-4a72-8ea3-aeda5be59cec tempest-SnapshotsActionsTest-1930914051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:01:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1f54e99a-085b-4a72-8ea3-aeda5be59cec tempest-SnapshotsActionsTest-1930914051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:01:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1f54e99a-085b-4a72-8ea3-aeda5be59cec tempest-SnapshotsActionsTest-1930914051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:01:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1f54e99a-085b-4a72-8ea3-aeda5be59cec tempest-SnapshotsActionsTest-1930914051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:01:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1f54e99a-085b-4a72-8ea3-aeda5be59cec tempest-SnapshotsActionsTest-1930914051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:01:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f54e99a-085b-4a72-8ea3-aeda5be59cec tempest-SnapshotsActionsTest-1930914051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:00 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:01:00 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:00 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f54e99a-085b-4a72-8ea3-aeda5be59cec tempest-SnapshotsActionsTest-1930914051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.389s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:00 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-1f54e99a-085b-4a72-8ea3-aeda5be59cec tempest-SnapshotsActionsTest-1930914051 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:01:00 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1f54e99a-085b-4a72-8ea3-aeda5be59cec tempest-SnapshotsActionsTest-1930914051 None] Deleted volume successfully. Sep 21 12:01:00 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1f54e99a-085b-4a72-8ea3-aeda5be59cec tempest-SnapshotsActionsTest-1930914051 None] Lock "cinder-5b9f506f-6ddd-485e-bdea-f3f42a527175-delete_volume" released by "delete_volume" :: held 2.227s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:01:01 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:01:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Flow 'volume_create_manager' (91105624-5f45-459d-bcdb-c5c3abbd7a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:01:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deebc72d-693d-41ac-9169-a6154ca331df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deebc72d-693d-41ac-9169-a6154ca331df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1830988798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4df58a93-cb0d-4533-99c8-f07178940385,host='devstack@QuobyteHD#QuobyteHD',id=e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d775184b136740b78bd9fa4b0e6c376e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:01:02Z,use_quota=True,user_id='7ce00b84d5a2416793336dbaf2dd56b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92954a5a-fffc-467c-9222-c40664b2173c),volume_type_id=92954a5a-fffc-467c-9222-c40664b2173c)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f281379-a697-4759-8473-c7b7c04fc14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f281379-a697-4759-8473-c7b7c04fc14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b09621a3-ff66-434d-8ad1-546c40c5ea48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b09621a3-ff66-434d-8ad1-546c40c5ea48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef', 'volume_name': 'volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf090c5f-944a-460a-98b4-6e1ca7b2d3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf090c5f-944a-460a-98b4-6e1ca7b2d3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9340d4a3-a74c-43c0-a4ca-dfdb6b6c9f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:01 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Volume e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef', 'volume_size': 1} Sep 21 12:01:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:01:03 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 12:01:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:01:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:01:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:01:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:01:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:01:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:03 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:01:03 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:04 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.480s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:04 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:01:04 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 12:01:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread count: 28 {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 12:01:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread info: [<_MainThread(MainThread, started 132841976594560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 12:01:05 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5cd0f7d6-2e43-44e1-aa4b-0589301d1775" returned: 0 in 7.431s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:05 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Image conversion details: src /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0, size 1024.00 MB, duration 7.43 sec, destination /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5cd0f7d6-2e43-44e1-aa4b-0589301d1775 {{(pid=86366) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 12:01:05 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Converted 1024.00 MB image at 137.79 MB/s Sep 21 12:01:05 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5cd0f7d6-2e43-44e1-aa4b-0589301d1775 is being set with open permissions: ugo+rw Sep 21 12:01:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5cd0f7d6-2e43-44e1-aa4b-0589301d1775 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:05 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5cd0f7d6-2e43-44e1-aa4b-0589301d1775 Sep 21 12:01:05 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:05 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5cd0f7d6-2e43-44e1-aa4b-0589301d1775" returned: 0 in 0.270s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-5cd0f7d6-2e43-44e1-aa4b-0589301d1775" released by "_copy_volume_from_snapshot" :: held 8.878s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:01:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-e0bd9bca-159d-4044-a826-c018559bd0ed-5cd0f7d6-2e43-44e1-aa4b-0589301d1775" released by "_create_volume_from_snapshot" :: held 8.964s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:01:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.980s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:01:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.240s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:01:05 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:00:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1961992950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ca5f1e6-8657-460b-baa9-b50764e6f6cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d97b6ec2addd49c6978bc901dafa278d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:00:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:00:58Z,use_quota=True,user_id='7a6dfa264dd94539917a90c675ac534c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:01:05 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Creating volume 2ca5f1e6-8657-460b-baa9-b50764e6f6cf {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:01:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:01:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:01:05 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:01:05 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:01:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:01:05 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:01:05 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:01:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf 2147483648 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:05 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf 2147483648 Sep 21 12:01:05 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c924d0df-85f7-4e91-8574-98fdd936b89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cd0f7d6-2e43-44e1-aa4b-0589301d1775', 'volume_size': 1, 'snapshot_id': 'e0bd9bca-159d-4044-a826-c018559bd0ed'}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f61c1e1-a21c-4086-9b9b-bbd60464ecb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:05 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Volume volume-5cd0f7d6-2e43-44e1-aa4b-0589301d1775 (5cd0f7d6-2e43-44e1-aa4b-0589301d1775): created successfully Sep 21 12:01:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f61c1e1-a21c-4086-9b9b-bbd60464ecb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Flow 'volume_create_manager' (472f4549-c591-428d-8bea-4bcf669b561d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:01:05 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-6738928d-5703-4970-9c62-00d2d4b8c4b8 tempest-VolumesSnapshotTestJSON-402880464 None] Created volume successfully. Sep 21 12:01:06 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf 2147483648" returned: 0 in 0.523s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:06 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf Sep 21 12:01:06 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:06 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf" returned: 0 in 0.262s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:06 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:01:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:01:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.693s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:01:06 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4df58a93-cb0d-4533-99c8-f07178940385,created_at=2026-09-21T10:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1830988798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4df58a93-cb0d-4533-99c8-f07178940385,host='devstack@QuobyteHD#QuobyteHD',id=e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d775184b136740b78bd9fa4b0e6c376e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:01:02Z,use_quota=True,user_id='7ce00b84d5a2416793336dbaf2dd56b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92954a5a-fffc-467c-9222-c40664b2173c),volume_type_id=92954a5a-fffc-467c-9222-c40664b2173c)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:01:06 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Creating volume e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:01:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:01:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:01:06 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:01:06 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:01:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:01:06 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:01:06 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:01:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:06 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef 1073741824 Sep 21 12:01:06 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:06 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e20f707d-8f30-4663-ae38-1285018b11df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf', 'volume_size': 2}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:06 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ac4818-2708-424c-af2d-a58f887cee5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:06 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-46f1ad5c-b8fd-4174-b779-fa91bfed675c tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "cinder-5cd0f7d6-2e43-44e1-aa4b-0589301d1775-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:01:06 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Volume volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf (2ca5f1e6-8657-460b-baa9-b50764e6f6cf): created successfully Sep 21 12:01:06 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65ac4818-2708-424c-af2d-a58f887cee5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:06 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Flow 'volume_create_manager' (25913888-c76e-4eec-939b-df4147eb4e3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:01:06 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-46f1ad5c-b8fd-4174-b779-fa91bfed675c tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-5cd0f7d6-2e43-44e1-aa4b-0589301d1775-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:01:06 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-44627022-3ee8-4b16-9c7a-48372d6b63e3 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Created volume successfully. Sep 21 12:01:06 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-46f1ad5c-b8fd-4174-b779-fa91bfed675c tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "cinder-quobyte-5cd0f7d6-2e43-44e1-aa4b-0589301d1775" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:01:06 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-46f1ad5c-b8fd-4174-b779-fa91bfed675c tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-5cd0f7d6-2e43-44e1-aa4b-0589301d1775" acquired by "delete_volume" :: waited 0.024s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:01:06 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[b712a922-426c-4af3-8c52-cfb4196e3a7d]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:01:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-46f1ad5c-b8fd-4174-b779-fa91bfed675c tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5cd0f7d6-2e43-44e1-aa4b-0589301d1775 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:06 devstack sudo[97670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5cd0f7d6-2e43-44e1-aa4b-0589301d1775 Sep 21 12:01:06 devstack sudo[97670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:07 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef 1073741824" returned: 0 in 0.547s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:07 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef Sep 21 12:01:07 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:07 devstack sudo[97670]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-46f1ad5c-b8fd-4174-b779-fa91bfed675c tempest-VolumesSnapshotTestJSON-402880464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5cd0f7d6-2e43-44e1-aa4b-0589301d1775" returned: 0 in 0.495s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-46f1ad5c-b8fd-4174-b779-fa91bfed675c tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5cd0f7d6-2e43-44e1-aa4b-0589301d1775 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:07 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5cd0f7d6-2e43-44e1-aa4b-0589301d1775 Sep 21 12:01:07 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:07 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef" returned: 0 in 0.324s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:01:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:01:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9340d4a3-a74c-43c0-a4ca-dfdb6b6c9f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89caba65-e0c6-4600-a663-5381c1212741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:07 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Volume volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef (e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef): created successfully Sep 21 12:01:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89caba65-e0c6-4600-a663-5381c1212741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Flow 'volume_create_manager' (91105624-5f45-459d-bcdb-c5c3abbd7a2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:01:07 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-cb042a30-8a61-4cd2-a868-2dbc2fd29c90 tempest-GroupSnapshotsTest-435114483 None] Created volume successfully. Sep 21 12:01:07 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-46f1ad5c-b8fd-4174-b779-fa91bfed675c tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-5cd0f7d6-2e43-44e1-aa4b-0589301d1775" returned: 0 in 0.380s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:07 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-46f1ad5c-b8fd-4174-b779-fa91bfed675c tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-5cd0f7d6-2e43-44e1-aa4b-0589301d1775" released by "delete_volume" :: held 0.938s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:01:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d09129c6-784a-498a-b28f-eb403c9de3e1 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:01:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d09129c6-784a-498a-b28f-eb403c9de3e1 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:01:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-d09129c6-784a-498a-b28f-eb403c9de3e1 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Creating offline snapshot 9cbb41c9-5fbc-46d8-b043-fdbeb1f50c1d of volume 2ca5f1e6-8657-460b-baa9-b50764e6f6cf {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:01:07 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc9fc3a-b08a-47d5-b62e-dab337d388bb]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:01:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d09129c6-784a-498a-b28f-eb403c9de3e1 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:07 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-46f1ad5c-b8fd-4174-b779-fa91bfed675c tempest-VolumesSnapshotTestJSON-402880464 None] Created reservations ['b2497b29-201c-4a87-9ba7-f57573914cf3', '1c16747f-bfe9-48bf-b196-3d44de130f7f', '43f97720-b3c2-49d9-9c06-bb1245990ad6', '6c6a03f1-726d-48a8-a51c-469b1cddb27c'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:01:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-46f1ad5c-b8fd-4174-b779-fa91bfed675c tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:01:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-46f1ad5c-b8fd-4174-b779-fa91bfed675c tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:01:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-46f1ad5c-b8fd-4174-b779-fa91bfed675c tempest-VolumesSnapshotTestJSON-402880464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:01:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-46f1ad5c-b8fd-4174-b779-fa91bfed675c tempest-VolumesSnapshotTestJSON-402880464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:01:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-46f1ad5c-b8fd-4174-b779-fa91bfed675c tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:01:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-46f1ad5c-b8fd-4174-b779-fa91bfed675c tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:07 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf Sep 21 12:01:07 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:07 devstack sudo[97687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:01:07 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:08 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-46f1ad5c-b8fd-4174-b779-fa91bfed675c tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.346s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:08 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-46f1ad5c-b8fd-4174-b779-fa91bfed675c tempest-VolumesSnapshotTestJSON-402880464 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:01:08 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:08 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-46f1ad5c-b8fd-4174-b779-fa91bfed675c tempest-VolumesSnapshotTestJSON-402880464 None] Deleted volume successfully. Sep 21 12:01:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d09129c6-784a-498a-b28f-eb403c9de3e1 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf" returned: 0 in 0.545s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d09129c6-784a-498a-b28f-eb403c9de3e1 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf.9cbb41c9-5fbc-46d8-b043-fdbeb1f50c1d 2G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:08 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-46f1ad5c-b8fd-4174-b779-fa91bfed675c tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-5cd0f7d6-2e43-44e1-aa4b-0589301d1775-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:01:08 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf.9cbb41c9-5fbc-46d8-b043-fdbeb1f50c1d 2G Sep 21 12:01:08 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:08 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-e6ba9873-3e7c-403a-b70f-3d2c904dcef3 tempest-GroupSnapshotsTest-435114483 None] GroupSnapshot 2e79b5e8-cb84-4189-986f-82488872daa3: creating. Sep 21 12:01:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e6ba9873-3e7c-403a-b70f-3d2c904dcef3 tempest-GroupSnapshotsTest-435114483 None] Group snapshot 2e79b5e8-cb84-4189-986f-82488872daa3: creating. {{(pid=86366) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 21 12:01:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e6ba9873-3e7c-403a-b70f-3d2c904dcef3 tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:01:08 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d09129c6-784a-498a-b28f-eb403c9de3e1 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf.9cbb41c9-5fbc-46d8-b043-fdbeb1f50c1d 2G" returned: 0 in 0.481s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d09129c6-784a-498a-b28f-eb403c9de3e1 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf.9cbb41c9-5fbc-46d8-b043-fdbeb1f50c1d {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:08 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf.9cbb41c9-5fbc-46d8-b043-fdbeb1f50c1d Sep 21 12:01:08 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:08 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7031f12e-c446-41ab-8843-0e51c134a5fa tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "cinder-e0bd9bca-159d-4044-a826-c018559bd0ed-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:01:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7031f12e-c446-41ab-8843-0e51c134a5fa tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-e0bd9bca-159d-4044-a826-c018559bd0ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:01:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7031f12e-c446-41ab-8843-0e51c134a5fa tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "cinder-quobyte-c2a0d455-6f24-48d5-965f-a4c34e3c10b0" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:01:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7031f12e-c446-41ab-8843-0e51c134a5fa tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-c2a0d455-6f24-48d5-965f-a4c34e3c10b0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:01:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7031f12e-c446-41ab-8843-0e51c134a5fa tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "cinder-quobyte-e0bd9bca-159d-4044-a826-c018559bd0ed" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:01:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7031f12e-c446-41ab-8843-0e51c134a5fa tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-e0bd9bca-159d-4044-a826-c018559bd0ed" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:01:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-7031f12e-c446-41ab-8843-0e51c134a5fa tempest-VolumesSnapshotTestJSON-402880464 None] Deleting offline snapshot e0bd9bca-159d-4044-a826-c018559bd0ed of volume c2a0d455-6f24-48d5-965f-a4c34e3c10b0 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:01:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-7031f12e-c446-41ab-8843-0e51c134a5fa tempest-VolumesSnapshotTestJSON-402880464 None] snapshot_file for this snap is: volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.e0bd9bca-159d-4044-a826-c018559bd0ed {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:01:09 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[337d2103-3d9b-42c0-9eb4-a187ca963c36]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:01:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7031f12e-c446-41ab-8843-0e51c134a5fa tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.e0bd9bca-159d-4044-a826-c018559bd0ed {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:09 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d09129c6-784a-498a-b28f-eb403c9de3e1 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf.9cbb41c9-5fbc-46d8-b043-fdbeb1f50c1d" returned: 0 in 0.327s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:09 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-d09129c6-784a-498a-b28f-eb403c9de3e1 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf.9cbb41c9-5fbc-46d8-b043-fdbeb1f50c1d is being set with open permissions: ugo+rw Sep 21 12:01:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d09129c6-784a-498a-b28f-eb403c9de3e1 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf.9cbb41c9-5fbc-46d8-b043-fdbeb1f50c1d {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:09 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf.9cbb41c9-5fbc-46d8-b043-fdbeb1f50c1d Sep 21 12:01:09 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:09 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.e0bd9bca-159d-4044-a826-c018559bd0ed Sep 21 12:01:09 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:09 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d09129c6-784a-498a-b28f-eb403c9de3e1 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf.9cbb41c9-5fbc-46d8-b043-fdbeb1f50c1d" returned: 0 in 0.276s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d09129c6-784a-498a-b28f-eb403c9de3e1 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:09 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf.info Sep 21 12:01:09 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:09 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7031f12e-c446-41ab-8843-0e51c134a5fa tempest-VolumesSnapshotTestJSON-402880464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.e0bd9bca-159d-4044-a826-c018559bd0ed" returned: 0 in 0.430s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-7031f12e-c446-41ab-8843-0e51c134a5fa tempest-VolumesSnapshotTestJSON-402880464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:01:09 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc485137-efd4-4368-845d-2789043e974e]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:01:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7031f12e-c446-41ab-8843-0e51c134a5fa tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:09 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0 Sep 21 12:01:09 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:09 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d09129c6-784a-498a-b28f-eb403c9de3e1 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf.info" returned: 0 in 0.294s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:09 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-d09129c6-784a-498a-b28f-eb403c9de3e1 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf.info is being set with open permissions: ugo+rw Sep 21 12:01:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d09129c6-784a-498a-b28f-eb403c9de3e1 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:09 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf.info Sep 21 12:01:09 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:10 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d09129c6-784a-498a-b28f-eb403c9de3e1 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf.info" returned: 0 in 0.269s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d09129c6-784a-498a-b28f-eb403c9de3e1 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.327s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:01:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e6ba9873-3e7c-403a-b70f-3d2c904dcef3 tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.634s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:01:10 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-e6ba9873-3e7c-403a-b70f-3d2c904dcef3 tempest-GroupSnapshotsTest-435114483 None] Creating offline snapshot 014e097c-9388-4eed-8b15-da2c40fdb939 of volume e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:01:10 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[203b52b6-3739-4bc5-8b62-87556b720bcb]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:01:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e6ba9873-3e7c-403a-b70f-3d2c904dcef3 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:10 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-d09129c6-784a-498a-b28f-eb403c9de3e1 tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Create snapshot completed successfully Sep 21 12:01:10 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7031f12e-c446-41ab-8843-0e51c134a5fa tempest-VolumesSnapshotTestJSON-402880464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0" returned: 0 in 0.636s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7031f12e-c446-41ab-8843-0e51c134a5fa tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.e0bd9bca-159d-4044-a826-c018559bd0ed {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:10 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.e0bd9bca-159d-4044-a826-c018559bd0ed Sep 21 12:01:10 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:10 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef Sep 21 12:01:10 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:10 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e6ba9873-3e7c-403a-b70f-3d2c904dcef3 tempest-GroupSnapshotsTest-435114483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef" returned: 0 in 0.450s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e6ba9873-3e7c-403a-b70f-3d2c904dcef3 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef.014e097c-9388-4eed-8b15-da2c40fdb939 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:10 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef.014e097c-9388-4eed-8b15-da2c40fdb939 1G Sep 21 12:01:10 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:10 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7031f12e-c446-41ab-8843-0e51c134a5fa tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.e0bd9bca-159d-4044-a826-c018559bd0ed" returned: 0 in 0.414s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7031f12e-c446-41ab-8843-0e51c134a5fa tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.e0bd9bca-159d-4044-a826-c018559bd0ed {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:10 devstack sudo[97737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.e0bd9bca-159d-4044-a826-c018559bd0ed Sep 21 12:01:10 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:10 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7031f12e-c446-41ab-8843-0e51c134a5fa tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0.e0bd9bca-159d-4044-a826-c018559bd0ed" returned: 0 in 0.283s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:10 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7031f12e-c446-41ab-8843-0e51c134a5fa tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-e0bd9bca-159d-4044-a826-c018559bd0ed" released by "_delete_snapshot" :: held 1.905s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:01:10 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7031f12e-c446-41ab-8843-0e51c134a5fa tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-c2a0d455-6f24-48d5-965f-a4c34e3c10b0" released by "delete_snapshot" :: held 1.936s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:01:10 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-78c0d263-08a7-4897-a076-93653658e55c tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Acquiring lock "cinder-9cbb41c9-5fbc-46d8-b043-fdbeb1f50c1d-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:01:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-78c0d263-08a7-4897-a076-93653658e55c tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Lock "cinder-9cbb41c9-5fbc-46d8-b043-fdbeb1f50c1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:01:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-78c0d263-08a7-4897-a076-93653658e55c tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Acquiring lock "cinder-quobyte-2ca5f1e6-8657-460b-baa9-b50764e6f6cf" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:01:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-78c0d263-08a7-4897-a076-93653658e55c tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Lock "cinder-quobyte-2ca5f1e6-8657-460b-baa9-b50764e6f6cf" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:01:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-78c0d263-08a7-4897-a076-93653658e55c tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Acquiring lock "cinder-quobyte-9cbb41c9-5fbc-46d8-b043-fdbeb1f50c1d" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:01:11 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-7031f12e-c446-41ab-8843-0e51c134a5fa tempest-VolumesSnapshotTestJSON-402880464 None] Created reservations ['73df6329-ca24-4d7e-83c5-b4385b344665', 'aa2b591a-7790-4d47-b269-bdf6eb3d7dc4', '67aef785-b0a7-4205-ab38-5b7512a8b7b6', 'f83df257-5c42-45c3-b610-b968f5b46912'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:01:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-78c0d263-08a7-4897-a076-93653658e55c tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Lock "cinder-quobyte-9cbb41c9-5fbc-46d8-b043-fdbeb1f50c1d" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:01:11 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-78c0d263-08a7-4897-a076-93653658e55c tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Deleting offline snapshot 9cbb41c9-5fbc-46d8-b043-fdbeb1f50c1d of volume 2ca5f1e6-8657-460b-baa9-b50764e6f6cf {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:01:11 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:11 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-78c0d263-08a7-4897-a076-93653658e55c tempest-VolumesSnapshotNegativeTestJSON-487760085 None] snapshot_file for this snap is: volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf.9cbb41c9-5fbc-46d8-b043-fdbeb1f50c1d {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:01:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e6ba9873-3e7c-403a-b70f-3d2c904dcef3 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef.014e097c-9388-4eed-8b15-da2c40fdb939 1G" returned: 0 in 0.579s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e6ba9873-3e7c-403a-b70f-3d2c904dcef3 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef.014e097c-9388-4eed-8b15-da2c40fdb939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:11 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d82677a-88c7-4d75-b45f-1cff77af3203]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:01:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-78c0d263-08a7-4897-a076-93653658e55c tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf.9cbb41c9-5fbc-46d8-b043-fdbeb1f50c1d {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:11 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef.014e097c-9388-4eed-8b15-da2c40fdb939 Sep 21 12:01:11 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:11 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-7031f12e-c446-41ab-8843-0e51c134a5fa tempest-VolumesSnapshotTestJSON-402880464 None] Delete snapshot completed successfully. Sep 21 12:01:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7031f12e-c446-41ab-8843-0e51c134a5fa tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-e0bd9bca-159d-4044-a826-c018559bd0ed-delete_snapshot" released by "delete_snapshot" :: held 2.246s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:01:11 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf.9cbb41c9-5fbc-46d8-b043-fdbeb1f50c1d Sep 21 12:01:11 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:11 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e6ba9873-3e7c-403a-b70f-3d2c904dcef3 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef.014e097c-9388-4eed-8b15-da2c40fdb939" returned: 0 in 0.391s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:11 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-e6ba9873-3e7c-403a-b70f-3d2c904dcef3 tempest-GroupSnapshotsTest-435114483 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef.014e097c-9388-4eed-8b15-da2c40fdb939 is being set with open permissions: ugo+rw: NotImplementedError Sep 21 12:01:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e6ba9873-3e7c-403a-b70f-3d2c904dcef3 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef.014e097c-9388-4eed-8b15-da2c40fdb939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:11 devstack sudo[97758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef.014e097c-9388-4eed-8b15-da2c40fdb939 Sep 21 12:01:11 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:11 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-78c0d263-08a7-4897-a076-93653658e55c tempest-VolumesSnapshotNegativeTestJSON-487760085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf.9cbb41c9-5fbc-46d8-b043-fdbeb1f50c1d" returned: 0 in 0.456s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:11 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-78c0d263-08a7-4897-a076-93653658e55c tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:01:11 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac8fa9b-14ab-4a16-849c-eec301aba7e1]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:01:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-78c0d263-08a7-4897-a076-93653658e55c tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:11 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf Sep 21 12:01:11 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:11 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e6ba9873-3e7c-403a-b70f-3d2c904dcef3 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef.014e097c-9388-4eed-8b15-da2c40fdb939" returned: 0 in 0.293s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e6ba9873-3e7c-403a-b70f-3d2c904dcef3 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:11 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef.info Sep 21 12:01:11 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:12 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-78c0d263-08a7-4897-a076-93653658e55c tempest-VolumesSnapshotNegativeTestJSON-487760085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf" returned: 0 in 0.457s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-78c0d263-08a7-4897-a076-93653658e55c tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf.9cbb41c9-5fbc-46d8-b043-fdbeb1f50c1d {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:12 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf.9cbb41c9-5fbc-46d8-b043-fdbeb1f50c1d Sep 21 12:01:12 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:12 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e6ba9873-3e7c-403a-b70f-3d2c904dcef3 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef.info" returned: 0 in 0.340s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:12 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-e6ba9873-3e7c-403a-b70f-3d2c904dcef3 tempest-GroupSnapshotsTest-435114483 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef.info is being set with open permissions: ugo+rw: NotImplementedError Sep 21 12:01:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e6ba9873-3e7c-403a-b70f-3d2c904dcef3 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:12 devstack sudo[97772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef.info Sep 21 12:01:12 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1160fd76-e358-44b0-bd04-5d66d354170b tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "cinder-c2a0d455-6f24-48d5-965f-a4c34e3c10b0-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:01:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1160fd76-e358-44b0-bd04-5d66d354170b tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-c2a0d455-6f24-48d5-965f-a4c34e3c10b0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:01:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1160fd76-e358-44b0-bd04-5d66d354170b tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "cinder-quobyte-c2a0d455-6f24-48d5-965f-a4c34e3c10b0" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:01:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1160fd76-e358-44b0-bd04-5d66d354170b tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-c2a0d455-6f24-48d5-965f-a4c34e3c10b0" acquired by "delete_volume" :: waited 0.018s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:01:12 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e6ba9873-3e7c-403a-b70f-3d2c904dcef3 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef.info" returned: 0 in 0.400s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e6ba9873-3e7c-403a-b70f-3d2c904dcef3 tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.562s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:01:12 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:12 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbc438e-85cb-4fcd-8387-d28e029632b4]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:01:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1160fd76-e358-44b0-bd04-5d66d354170b tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-78c0d263-08a7-4897-a076-93653658e55c tempest-VolumesSnapshotNegativeTestJSON-487760085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf.9cbb41c9-5fbc-46d8-b043-fdbeb1f50c1d" returned: 0 in 0.536s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-78c0d263-08a7-4897-a076-93653658e55c tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf.9cbb41c9-5fbc-46d8-b043-fdbeb1f50c1d {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:12 devstack sudo[97779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf.9cbb41c9-5fbc-46d8-b043-fdbeb1f50c1d Sep 21 12:01:12 devstack sudo[97779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:12 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-e6ba9873-3e7c-403a-b70f-3d2c904dcef3 tempest-GroupSnapshotsTest-435114483 None] group_snapshot 2e79b5e8-cb84-4189-986f-82488872daa3: created successfully Sep 21 12:01:12 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0 Sep 21 12:01:12 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:12 devstack sudo[97779]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-78c0d263-08a7-4897-a076-93653658e55c tempest-VolumesSnapshotNegativeTestJSON-487760085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf.9cbb41c9-5fbc-46d8-b043-fdbeb1f50c1d" returned: 0 in 0.311s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:13 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-78c0d263-08a7-4897-a076-93653658e55c tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Lock "cinder-quobyte-9cbb41c9-5fbc-46d8-b043-fdbeb1f50c1d" released by "_delete_snapshot" :: held 1.905s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:01:13 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-78c0d263-08a7-4897-a076-93653658e55c tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Lock "cinder-quobyte-2ca5f1e6-8657-460b-baa9-b50764e6f6cf" released by "delete_snapshot" :: held 1.948s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:01:13 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1160fd76-e358-44b0-bd04-5d66d354170b tempest-VolumesSnapshotTestJSON-402880464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0" returned: 0 in 0.408s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1160fd76-e358-44b0-bd04-5d66d354170b tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:13 devstack sudo[97786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0 Sep 21 12:01:13 devstack sudo[97786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:13 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-78c0d263-08a7-4897-a076-93653658e55c tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Created reservations ['74365213-9d92-4ebf-9d4f-d0fe5f41b8d1', 'c3324a07-f155-48ee-bc0d-59a814a89fc6', '693f70b0-6869-458e-9794-b4fc8763be2e', 'bd67a8c8-681c-4080-a19a-54deeec6858e'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:01:13 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-78c0d263-08a7-4897-a076-93653658e55c tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Delete snapshot completed successfully. Sep 21 12:01:13 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-78c0d263-08a7-4897-a076-93653658e55c tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Lock "cinder-9cbb41c9-5fbc-46d8-b043-fdbeb1f50c1d-delete_snapshot" released by "delete_snapshot" :: held 2.154s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:01:13 devstack sudo[97786]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1160fd76-e358-44b0-bd04-5d66d354170b tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c2a0d455-6f24-48d5-965f-a4c34e3c10b0" returned: 0 in 0.282s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:13 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1160fd76-e358-44b0-bd04-5d66d354170b tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-c2a0d455-6f24-48d5-965f-a4c34e3c10b0" released by "delete_volume" :: held 0.808s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:01:13 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-1160fd76-e358-44b0-bd04-5d66d354170b tempest-VolumesSnapshotTestJSON-402880464 None] Created reservations ['9541835a-f281-44ac-aa49-a2160f4dbea8', '035d1973-650a-4af4-beeb-50f958184b7b', '7eefb272-e14d-44c8-a017-44b6368ec158', 'ba22408e-6859-46a9-a798-c3962d468547'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:01:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1160fd76-e358-44b0-bd04-5d66d354170b tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:01:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1160fd76-e358-44b0-bd04-5d66d354170b tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:01:13 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1160fd76-e358-44b0-bd04-5d66d354170b tempest-VolumesSnapshotTestJSON-402880464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:01:13 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1160fd76-e358-44b0-bd04-5d66d354170b tempest-VolumesSnapshotTestJSON-402880464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:01:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1160fd76-e358-44b0-bd04-5d66d354170b tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:01:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1160fd76-e358-44b0-bd04-5d66d354170b tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:13 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:01:13 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:13 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f559155b-2d62-473a-a2a4-05b7f6cfce47 tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "cinder-17db2cf7-88ca-4cd0-a7dc-bc2862271994-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:01:13 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f559155b-2d62-473a-a2a4-05b7f6cfce47 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-17db2cf7-88ca-4cd0-a7dc-bc2862271994-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:01:13 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f559155b-2d62-473a-a2a4-05b7f6cfce47 tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "cinder-quobyte-17db2cf7-88ca-4cd0-a7dc-bc2862271994" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:01:13 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f559155b-2d62-473a-a2a4-05b7f6cfce47 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-17db2cf7-88ca-4cd0-a7dc-bc2862271994" acquired by "delete_volume" :: waited 0.019s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:01:13 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1160fd76-e358-44b0-bd04-5d66d354170b tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.312s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:13 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-1160fd76-e358-44b0-bd04-5d66d354170b tempest-VolumesSnapshotTestJSON-402880464 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:01:13 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1160fd76-e358-44b0-bd04-5d66d354170b tempest-VolumesSnapshotTestJSON-402880464 None] Deleted volume successfully. Sep 21 12:01:13 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9d26e6-17b5-45a8-9bbd-95447f92b1f9]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:01:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f559155b-2d62-473a-a2a4-05b7f6cfce47 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:13 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1160fd76-e358-44b0-bd04-5d66d354170b tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-c2a0d455-6f24-48d5-965f-a4c34e3c10b0-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:01:13 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-e10e6c9c-0a7b-468c-8665-b230d175d199 tempest-GroupSnapshotsTest-435114483 None] group_snapshot 2e79b5e8-cb84-4189-986f-82488872daa3: deleting Sep 21 12:01:13 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994 Sep 21 12:01:13 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:13 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e10e6c9c-0a7b-468c-8665-b230d175d199 tempest-GroupSnapshotsTest-435114483 None] group_snapshot 2e79b5e8-cb84-4189-986f-82488872daa3: deleting {{(pid=86366) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 21 12:01:13 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e10e6c9c-0a7b-468c-8665-b230d175d199 tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "cinder-quobyte-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:01:13 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e10e6c9c-0a7b-468c-8665-b230d175d199 tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:01:13 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e10e6c9c-0a7b-468c-8665-b230d175d199 tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "cinder-quobyte-014e097c-9388-4eed-8b15-da2c40fdb939" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:01:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e10e6c9c-0a7b-468c-8665-b230d175d199 tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-014e097c-9388-4eed-8b15-da2c40fdb939" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:01:14 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-e10e6c9c-0a7b-468c-8665-b230d175d199 tempest-GroupSnapshotsTest-435114483 None] Deleting offline snapshot 014e097c-9388-4eed-8b15-da2c40fdb939 of volume e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:01:14 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-e10e6c9c-0a7b-468c-8665-b230d175d199 tempest-GroupSnapshotsTest-435114483 None] snapshot_file for this snap is: volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef.014e097c-9388-4eed-8b15-da2c40fdb939 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:01:14 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec3749a-fab7-4f8f-a776-22a2424b6c0e]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:01:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e10e6c9c-0a7b-468c-8665-b230d175d199 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef.014e097c-9388-4eed-8b15-da2c40fdb939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:14 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef.014e097c-9388-4eed-8b15-da2c40fdb939 Sep 21 12:01:14 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:14 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-14d0999c-9441-42be-b630-2c22bea41b9e tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Acquiring lock "cinder-2ca5f1e6-8657-460b-baa9-b50764e6f6cf-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:01:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f559155b-2d62-473a-a2a4-05b7f6cfce47 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994" returned: 0 in 0.547s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f559155b-2d62-473a-a2a4-05b7f6cfce47 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-14d0999c-9441-42be-b630-2c22bea41b9e tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Lock "cinder-2ca5f1e6-8657-460b-baa9-b50764e6f6cf-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:01:14 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994 Sep 21 12:01:14 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-14d0999c-9441-42be-b630-2c22bea41b9e tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Acquiring lock "cinder-quobyte-2ca5f1e6-8657-460b-baa9-b50764e6f6cf" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:01:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-14d0999c-9441-42be-b630-2c22bea41b9e tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Lock "cinder-quobyte-2ca5f1e6-8657-460b-baa9-b50764e6f6cf" acquired by "delete_volume" :: waited 0.016s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:01:14 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc4ac05-8580-4b78-a095-e12979f20d9b]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:01:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-14d0999c-9441-42be-b630-2c22bea41b9e tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:14 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e10e6c9c-0a7b-468c-8665-b230d175d199 tempest-GroupSnapshotsTest-435114483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef.014e097c-9388-4eed-8b15-da2c40fdb939" returned: 0 in 0.521s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:14 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-e10e6c9c-0a7b-468c-8665-b230d175d199 tempest-GroupSnapshotsTest-435114483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:01:14 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[332c0091-35e6-4a06-a4ff-82fe9820311c]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:01:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e10e6c9c-0a7b-468c-8665-b230d175d199 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:14 devstack sudo[97803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf Sep 21 12:01:14 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:14 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f559155b-2d62-473a-a2a4-05b7f6cfce47 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-17db2cf7-88ca-4cd0-a7dc-bc2862271994" returned: 0 in 0.314s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f559155b-2d62-473a-a2a4-05b7f6cfce47 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-quobyte-17db2cf7-88ca-4cd0-a7dc-bc2862271994" released by "delete_volume" :: held 0.968s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:01:14 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef Sep 21 12:01:14 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:14 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-f559155b-2d62-473a-a2a4-05b7f6cfce47 tempest-VolumesSnapshotTestJSON-402880464 None] Created reservations ['2eb88bcc-a576-4e79-a060-7f124bb61252', '59cb693b-a2a5-41a2-8712-65eda0e72d97', '6bb8a218-9e28-482a-9ad4-ca986eb5a8e8', 'b2572e52-05d4-459b-82a6-d740ae075951'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:01:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f559155b-2d62-473a-a2a4-05b7f6cfce47 tempest-VolumesSnapshotTestJSON-402880464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:01:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f559155b-2d62-473a-a2a4-05b7f6cfce47 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:01:14 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f559155b-2d62-473a-a2a4-05b7f6cfce47 tempest-VolumesSnapshotTestJSON-402880464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:01:14 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f559155b-2d62-473a-a2a4-05b7f6cfce47 tempest-VolumesSnapshotTestJSON-402880464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:01:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f559155b-2d62-473a-a2a4-05b7f6cfce47 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:01:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f559155b-2d62-473a-a2a4-05b7f6cfce47 tempest-VolumesSnapshotTestJSON-402880464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:14 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:01:14 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:14 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-14d0999c-9441-42be-b630-2c22bea41b9e tempest-VolumesSnapshotNegativeTestJSON-487760085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf" returned: 0 in 0.496s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-14d0999c-9441-42be-b630-2c22bea41b9e tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:15 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf Sep 21 12:01:15 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:15 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e10e6c9c-0a7b-468c-8665-b230d175d199 tempest-GroupSnapshotsTest-435114483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef" returned: 0 in 0.506s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e10e6c9c-0a7b-468c-8665-b230d175d199 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef.014e097c-9388-4eed-8b15-da2c40fdb939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:15 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef.014e097c-9388-4eed-8b15-da2c40fdb939 Sep 21 12:01:15 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:15 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f559155b-2d62-473a-a2a4-05b7f6cfce47 tempest-VolumesSnapshotTestJSON-402880464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.361s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:15 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-f559155b-2d62-473a-a2a4-05b7f6cfce47 tempest-VolumesSnapshotTestJSON-402880464 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:01:15 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-f559155b-2d62-473a-a2a4-05b7f6cfce47 tempest-VolumesSnapshotTestJSON-402880464 None] Deleted volume successfully. Sep 21 12:01:15 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f559155b-2d62-473a-a2a4-05b7f6cfce47 tempest-VolumesSnapshotTestJSON-402880464 None] Lock "cinder-17db2cf7-88ca-4cd0-a7dc-bc2862271994-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:01:15 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-14d0999c-9441-42be-b630-2c22bea41b9e tempest-VolumesSnapshotNegativeTestJSON-487760085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2ca5f1e6-8657-460b-baa9-b50764e6f6cf" returned: 0 in 0.320s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:15 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-14d0999c-9441-42be-b630-2c22bea41b9e tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Lock "cinder-quobyte-2ca5f1e6-8657-460b-baa9-b50764e6f6cf" released by "delete_volume" :: held 0.901s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:01:15 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-14d0999c-9441-42be-b630-2c22bea41b9e tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Created reservations ['df013b6c-cebf-4364-97cb-cc5c0f5f3d45', '6cef0e20-4f8b-4fb0-8731-d65473b426ab', '70d4efb2-c9bb-419b-85c1-0b473c8b275b', '0f81faf2-6a45-4145-9edb-46e1c8ec62d3'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:01:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-14d0999c-9441-42be-b630-2c22bea41b9e tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:01:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-14d0999c-9441-42be-b630-2c22bea41b9e tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:01:15 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-14d0999c-9441-42be-b630-2c22bea41b9e tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:01:15 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-14d0999c-9441-42be-b630-2c22bea41b9e tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:01:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-14d0999c-9441-42be-b630-2c22bea41b9e tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:01:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-14d0999c-9441-42be-b630-2c22bea41b9e tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:15 devstack sudo[97829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:01:15 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:15 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e10e6c9c-0a7b-468c-8665-b230d175d199 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef.014e097c-9388-4eed-8b15-da2c40fdb939" returned: 0 in 0.466s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e10e6c9c-0a7b-468c-8665-b230d175d199 tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef.014e097c-9388-4eed-8b15-da2c40fdb939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:15 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef.014e097c-9388-4eed-8b15-da2c40fdb939 Sep 21 12:01:15 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:15 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-14d0999c-9441-42be-b630-2c22bea41b9e tempest-VolumesSnapshotNegativeTestJSON-487760085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.349s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:15 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-14d0999c-9441-42be-b630-2c22bea41b9e tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:01:15 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-14d0999c-9441-42be-b630-2c22bea41b9e tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Deleted volume successfully. Sep 21 12:01:15 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-14d0999c-9441-42be-b630-2c22bea41b9e tempest-VolumesSnapshotNegativeTestJSON-487760085 None] Lock "cinder-2ca5f1e6-8657-460b-baa9-b50764e6f6cf-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:01:15 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e10e6c9c-0a7b-468c-8665-b230d175d199 tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef.014e097c-9388-4eed-8b15-da2c40fdb939" returned: 0 in 0.338s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:15 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e10e6c9c-0a7b-468c-8665-b230d175d199 tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-014e097c-9388-4eed-8b15-da2c40fdb939" released by "_delete_snapshot" :: held 1.984s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:01:16 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e10e6c9c-0a7b-468c-8665-b230d175d199 tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef" released by "delete_snapshot" :: held 2.009s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:01:16 devstack cinder-volume[86366]: WARNING cinder.quota [None req-e10e6c9c-0a7b-468c-8665-b230d175d199 tempest-GroupSnapshotsTest-435114483 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1889754986 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1889754986, it is now deprecated. Please use the default quota class for default quota. Sep 21 12:01:16 devstack cinder-volume[86366]: WARNING cinder.quota [None req-e10e6c9c-0a7b-468c-8665-b230d175d199 tempest-GroupSnapshotsTest-435114483 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1889754986 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1889754986, it is now deprecated. Please use the default quota class for default quota. Sep 21 12:01:16 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-e10e6c9c-0a7b-468c-8665-b230d175d199 tempest-GroupSnapshotsTest-435114483 None] Created reservations ['4fc971c7-3259-441a-abcd-fb11f0129e51', 'c31e3b25-4a2c-4ec1-aea9-d8a30613789a', '37ad1c67-389d-4535-b80b-cc47f601a07e', '3cbc0f24-a794-498b-8396-0482bbecb652'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:01:16 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-e10e6c9c-0a7b-468c-8665-b230d175d199 tempest-GroupSnapshotsTest-435114483 None] group_snapshot 2e79b5e8-cb84-4189-986f-82488872daa3: deleted successfully Sep 21 12:01:16 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-19903e49-6c42-4b81-a08c-7a6bc4ded17f tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "cinder-quobyte-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:01:16 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-19903e49-6c42-4b81-a08c-7a6bc4ded17f tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef" acquired by "delete_volume" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:01:16 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c02cfb8-2b6b-4808-af3c-b4e1be064731]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:01:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-19903e49-6c42-4b81-a08c-7a6bc4ded17f tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:16 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef Sep 21 12:01:16 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:17 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-19903e49-6c42-4b81-a08c-7a6bc4ded17f tempest-GroupSnapshotsTest-435114483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef" returned: 0 in 0.490s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-19903e49-6c42-4b81-a08c-7a6bc4ded17f tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:17 devstack sudo[97840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef Sep 21 12:01:17 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:17 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:01:17 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Flow 'volume_create_manager' (dd197929-cb62-455d-8adb-8b22160a9d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:01:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6da2ec7-ac85-498d-b455-b9297e0c8fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-19903e49-6c42-4b81-a08c-7a6bc4ded17f tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef" returned: 0 in 0.344s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6da2ec7-ac85-498d-b455-b9297e0c8fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1412317924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c2352b0-b0c5-4fc3-baf3-13a38b1f5257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700d28e0a6d24aecb8e0ad8b947d6360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:01:17Z,use_quota=True,user_id='2c83bfd8019a416c914e5adc35c61572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c337a8d3-7427-4db7-9566-49ebfba8efd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c337a8d3-7427-4db7-9566-49ebfba8efd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dabe640-c759-4399-85b8-dd2cdd9bf4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dabe640-c759-4399-85b8-dd2cdd9bf4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c2352b0-b0c5-4fc3-baf3-13a38b1f5257', 'volume_name': 'volume-1c2352b0-b0c5-4fc3-baf3-13a38b1f5257', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4489f31-1acb-4ef2-be29-7f09ba691139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4489f31-1acb-4ef2-be29-7f09ba691139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec6deb8-0fb0-44a7-b552-8ae0d74b46d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:17 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Volume 1c2352b0-b0c5-4fc3-baf3-13a38b1f5257: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c2352b0-b0c5-4fc3-baf3-13a38b1f5257', 'volume_size': 1} Sep 21 12:01:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:01:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:01:17 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1412317924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c2352b0-b0c5-4fc3-baf3-13a38b1f5257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700d28e0a6d24aecb8e0ad8b947d6360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:01:17Z,use_quota=True,user_id='2c83bfd8019a416c914e5adc35c61572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:01:17 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Creating volume 1c2352b0-b0c5-4fc3-baf3-13a38b1f5257 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:01:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:01:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:01:17 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:01:17 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:01:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:01:17 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:01:17 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:01:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1c2352b0-b0c5-4fc3-baf3-13a38b1f5257 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-19903e49-6c42-4b81-a08c-7a6bc4ded17f tempest-GroupSnapshotsTest-435114483 None] Lock "cinder-quobyte-e1b5a359-8b1d-4c3c-88dc-72e91b93d4ef" released by "delete_volume" :: held 0.999s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:01:17 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1c2352b0-b0c5-4fc3-baf3-13a38b1f5257 1073741824 Sep 21 12:01:17 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:17 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-19903e49-6c42-4b81-a08c-7a6bc4ded17f tempest-GroupSnapshotsTest-435114483 None] Created reservations ['154286cf-0f9a-464d-b809-da7e2f3d5cf9'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:01:17 devstack cinder-volume[86366]: WARNING cinder.quota [None req-19903e49-6c42-4b81-a08c-7a6bc4ded17f tempest-GroupSnapshotsTest-435114483 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1889754986 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1889754986, it is now deprecated. Please use the default quota class for default quota. Sep 21 12:01:17 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-19903e49-6c42-4b81-a08c-7a6bc4ded17f tempest-GroupSnapshotsTest-435114483 None] Created reservations ['1d42b82c-5150-43a0-916c-428886241b6b', 'b897de16-b53d-475b-9363-8b8328774898', '4fcb9475-16e1-459a-a3ad-aabfe5617e8c', 'e1a5d889-9f79-4b2e-90d8-9612a43c6201'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:01:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-19903e49-6c42-4b81-a08c-7a6bc4ded17f tempest-GroupSnapshotsTest-435114483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:01:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-19903e49-6c42-4b81-a08c-7a6bc4ded17f tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:01:18 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-19903e49-6c42-4b81-a08c-7a6bc4ded17f tempest-GroupSnapshotsTest-435114483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:01:18 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-19903e49-6c42-4b81-a08c-7a6bc4ded17f tempest-GroupSnapshotsTest-435114483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:01:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-19903e49-6c42-4b81-a08c-7a6bc4ded17f tempest-GroupSnapshotsTest-435114483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:01:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-19903e49-6c42-4b81-a08c-7a6bc4ded17f tempest-GroupSnapshotsTest-435114483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:18 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:01:18 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:18 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1c2352b0-b0c5-4fc3-baf3-13a38b1f5257 1073741824" returned: 0 in 0.696s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:18 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-19903e49-6c42-4b81-a08c-7a6bc4ded17f tempest-GroupSnapshotsTest-435114483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.322s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:18 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-19903e49-6c42-4b81-a08c-7a6bc4ded17f tempest-GroupSnapshotsTest-435114483 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:01:18 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-19903e49-6c42-4b81-a08c-7a6bc4ded17f tempest-GroupSnapshotsTest-435114483 None] Delete group completed successfully. Sep 21 12:01:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1c2352b0-b0c5-4fc3-baf3-13a38b1f5257 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:18 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1c2352b0-b0c5-4fc3-baf3-13a38b1f5257 Sep 21 12:01:18 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:18 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1c2352b0-b0c5-4fc3-baf3-13a38b1f5257" returned: 0 in 0.290s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:18 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:01:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:01:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec6deb8-0fb0-44a7-b552-8ae0d74b46d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c2352b0-b0c5-4fc3-baf3-13a38b1f5257', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8df64ae-eee3-4aca-96a2-e3b72bc4befd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:18 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Volume volume-1c2352b0-b0c5-4fc3-baf3-13a38b1f5257 (1c2352b0-b0c5-4fc3-baf3-13a38b1f5257): created successfully Sep 21 12:01:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8df64ae-eee3-4aca-96a2-e3b72bc4befd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Flow 'volume_create_manager' (dd197929-cb62-455d-8adb-8b22160a9d46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:01:18 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-4a5dae66-a92e-45bb-b235-74f21d4f3a37 tempest-VolumeQuotasAdminTestJSON-127664277 None] Created volume successfully. Sep 21 12:01:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4d8aa57c-b456-41ed-8f62-b60825933765 tempest-VolumeQuotasAdminTestJSON-127664277 None] Acquiring lock "cinder-1c2352b0-b0c5-4fc3-baf3-13a38b1f5257-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:01:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4d8aa57c-b456-41ed-8f62-b60825933765 tempest-VolumeQuotasAdminTestJSON-127664277 None] Lock "cinder-1c2352b0-b0c5-4fc3-baf3-13a38b1f5257-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:01:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4d8aa57c-b456-41ed-8f62-b60825933765 tempest-VolumeQuotasAdminTestJSON-127664277 None] Acquiring lock "cinder-quobyte-1c2352b0-b0c5-4fc3-baf3-13a38b1f5257" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:01:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4d8aa57c-b456-41ed-8f62-b60825933765 tempest-VolumeQuotasAdminTestJSON-127664277 None] Lock "cinder-quobyte-1c2352b0-b0c5-4fc3-baf3-13a38b1f5257" acquired by "delete_volume" :: waited 0.024s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:01:19 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2c5ebc-50dd-414b-a407-6402a22a3e40]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:01:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4d8aa57c-b456-41ed-8f62-b60825933765 tempest-VolumeQuotasAdminTestJSON-127664277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1c2352b0-b0c5-4fc3-baf3-13a38b1f5257 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:19 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1c2352b0-b0c5-4fc3-baf3-13a38b1f5257 Sep 21 12:01:19 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:20 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4d8aa57c-b456-41ed-8f62-b60825933765 tempest-VolumeQuotasAdminTestJSON-127664277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1c2352b0-b0c5-4fc3-baf3-13a38b1f5257" returned: 0 in 0.572s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4d8aa57c-b456-41ed-8f62-b60825933765 tempest-VolumeQuotasAdminTestJSON-127664277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1c2352b0-b0c5-4fc3-baf3-13a38b1f5257 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:20 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1c2352b0-b0c5-4fc3-baf3-13a38b1f5257 Sep 21 12:01:20 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:20 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4d8aa57c-b456-41ed-8f62-b60825933765 tempest-VolumeQuotasAdminTestJSON-127664277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1c2352b0-b0c5-4fc3-baf3-13a38b1f5257" returned: 0 in 0.305s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:20 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4d8aa57c-b456-41ed-8f62-b60825933765 tempest-VolumeQuotasAdminTestJSON-127664277 None] Lock "cinder-quobyte-1c2352b0-b0c5-4fc3-baf3-13a38b1f5257" released by "delete_volume" :: held 0.939s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:01:20 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-4d8aa57c-b456-41ed-8f62-b60825933765 tempest-VolumeQuotasAdminTestJSON-127664277 None] Created reservations ['2a6fbc47-98cd-4e5f-8344-ac7d86fbee95', '4e79ec00-9d09-44f0-a975-c743800542a3', '54d52990-e95c-4715-8d22-7edc7d4408f1', 'f67af78c-d86e-42e8-9208-8ee8b5aee0ea'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:01:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4d8aa57c-b456-41ed-8f62-b60825933765 tempest-VolumeQuotasAdminTestJSON-127664277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:01:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4d8aa57c-b456-41ed-8f62-b60825933765 tempest-VolumeQuotasAdminTestJSON-127664277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:01:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4d8aa57c-b456-41ed-8f62-b60825933765 tempest-VolumeQuotasAdminTestJSON-127664277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:01:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4d8aa57c-b456-41ed-8f62-b60825933765 tempest-VolumeQuotasAdminTestJSON-127664277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:01:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4d8aa57c-b456-41ed-8f62-b60825933765 tempest-VolumeQuotasAdminTestJSON-127664277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:01:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4d8aa57c-b456-41ed-8f62-b60825933765 tempest-VolumeQuotasAdminTestJSON-127664277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:20 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:01:20 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:21 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4d8aa57c-b456-41ed-8f62-b60825933765 tempest-VolumeQuotasAdminTestJSON-127664277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.323s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:21 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-4d8aa57c-b456-41ed-8f62-b60825933765 tempest-VolumeQuotasAdminTestJSON-127664277 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:01:21 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-4d8aa57c-b456-41ed-8f62-b60825933765 tempest-VolumeQuotasAdminTestJSON-127664277 None] Deleted volume successfully. Sep 21 12:01:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4d8aa57c-b456-41ed-8f62-b60825933765 tempest-VolumeQuotasAdminTestJSON-127664277 None] Lock "cinder-1c2352b0-b0c5-4fc3-baf3-13a38b1f5257-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:01:22 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:01:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Flow 'volume_create_manager' (34f12c2b-e16d-43e1-b16c-dbf0ad1a8a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:01:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488b9201-20bd-43e8-965f-1cf4f1ed0dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488b9201-20bd-43e8-965f-1cf4f1ed0dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-941059900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75fd0972-2bef-45f5-9dbf-439a1306a79d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700d28e0a6d24aecb8e0ad8b947d6360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:01:23Z,use_quota=True,user_id='2c83bfd8019a416c914e5adc35c61572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081c9333-6d1e-45a1-a6e4-d895dd7302f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081c9333-6d1e-45a1-a6e4-d895dd7302f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee4d5d3-d27b-4c1a-8f19-2ecd94c8dc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee4d5d3-d27b-4c1a-8f19-2ecd94c8dc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75fd0972-2bef-45f5-9dbf-439a1306a79d', 'volume_name': 'volume-75fd0972-2bef-45f5-9dbf-439a1306a79d', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd398a99-490f-4850-af3b-c73c7efec109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd398a99-490f-4850-af3b-c73c7efec109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c299ac8d-9d31-4764-84a3-d766e9edab40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:22 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Volume 75fd0972-2bef-45f5-9dbf-439a1306a79d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75fd0972-2bef-45f5-9dbf-439a1306a79d', 'volume_size': 1} Sep 21 12:01:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:01:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:01:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-941059900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75fd0972-2bef-45f5-9dbf-439a1306a79d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700d28e0a6d24aecb8e0ad8b947d6360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:01:23Z,use_quota=True,user_id='2c83bfd8019a416c914e5adc35c61572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:01:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Creating volume 75fd0972-2bef-45f5-9dbf-439a1306a79d {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:01:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:01:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:01:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:01:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:01:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:01:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:01:22 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:01:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-75fd0972-2bef-45f5-9dbf-439a1306a79d 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:22 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-75fd0972-2bef-45f5-9dbf-439a1306a79d 1073741824 Sep 21 12:01:22 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:23 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-75fd0972-2bef-45f5-9dbf-439a1306a79d 1073741824" returned: 0 in 0.567s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-75fd0972-2bef-45f5-9dbf-439a1306a79d {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:23 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-75fd0972-2bef-45f5-9dbf-439a1306a79d Sep 21 12:01:23 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:23 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-75fd0972-2bef-45f5-9dbf-439a1306a79d" returned: 0 in 0.385s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:23 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:01:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:01:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c299ac8d-9d31-4764-84a3-d766e9edab40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75fd0972-2bef-45f5-9dbf-439a1306a79d', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6b73b36-c770-4be7-a385-523491f49b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:23 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Volume volume-75fd0972-2bef-45f5-9dbf-439a1306a79d (75fd0972-2bef-45f5-9dbf-439a1306a79d): created successfully Sep 21 12:01:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6b73b36-c770-4be7-a385-523491f49b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Flow 'volume_create_manager' (34f12c2b-e16d-43e1-b16c-dbf0ad1a8a6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:01:23 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-905fc73d-e937-4449-9307-9ced9048375f tempest-VolumeQuotasAdminTestJSON-127664277 None] Created volume successfully. Sep 21 12:01:26 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-8ffdd79e-1945-4ae6-ab11-81146df83a70 tempest-VolumeQuotasAdminTestJSON-882313333 None] Transfer volume completed successfully. Sep 21 12:01:26 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-29f3c03b-e105-439a-a515-1c7af7ce384f tempest-VolumeQuotasAdminTestJSON-1934343982 None] Acquiring lock "cinder-75fd0972-2bef-45f5-9dbf-439a1306a79d-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:01:26 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-29f3c03b-e105-439a-a515-1c7af7ce384f tempest-VolumeQuotasAdminTestJSON-1934343982 None] Lock "cinder-75fd0972-2bef-45f5-9dbf-439a1306a79d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:01:26 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-29f3c03b-e105-439a-a515-1c7af7ce384f tempest-VolumeQuotasAdminTestJSON-1934343982 None] Acquiring lock "cinder-quobyte-75fd0972-2bef-45f5-9dbf-439a1306a79d" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:01:26 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-29f3c03b-e105-439a-a515-1c7af7ce384f tempest-VolumeQuotasAdminTestJSON-1934343982 None] Lock "cinder-quobyte-75fd0972-2bef-45f5-9dbf-439a1306a79d" acquired by "delete_volume" :: waited 0.019s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:01:26 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e08354b-fd83-4a97-a2c1-e68ed5109530]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:01:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-29f3c03b-e105-439a-a515-1c7af7ce384f tempest-VolumeQuotasAdminTestJSON-1934343982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-75fd0972-2bef-45f5-9dbf-439a1306a79d {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:27 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-75fd0972-2bef-45f5-9dbf-439a1306a79d Sep 21 12:01:27 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:27 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-29f3c03b-e105-439a-a515-1c7af7ce384f tempest-VolumeQuotasAdminTestJSON-1934343982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-75fd0972-2bef-45f5-9dbf-439a1306a79d" returned: 0 in 0.534s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-29f3c03b-e105-439a-a515-1c7af7ce384f tempest-VolumeQuotasAdminTestJSON-1934343982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-75fd0972-2bef-45f5-9dbf-439a1306a79d {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:27 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-75fd0972-2bef-45f5-9dbf-439a1306a79d Sep 21 12:01:27 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:27 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-29f3c03b-e105-439a-a515-1c7af7ce384f tempest-VolumeQuotasAdminTestJSON-1934343982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-75fd0972-2bef-45f5-9dbf-439a1306a79d" returned: 0 in 0.403s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:27 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-29f3c03b-e105-439a-a515-1c7af7ce384f tempest-VolumeQuotasAdminTestJSON-1934343982 None] Lock "cinder-quobyte-75fd0972-2bef-45f5-9dbf-439a1306a79d" released by "delete_volume" :: held 1.028s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:01:27 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-29f3c03b-e105-439a-a515-1c7af7ce384f tempest-VolumeQuotasAdminTestJSON-1934343982 None] Created reservations ['d549556f-c0c2-454d-894b-c5cd9bfd05cc', 'cda980bc-14fd-4968-8a60-04abfe4d0718', 'ec6bc159-ffc9-4298-bc78-779753c208d7', 'a993c140-dd76-4818-aabe-4eafc1728402'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:01:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-29f3c03b-e105-439a-a515-1c7af7ce384f tempest-VolumeQuotasAdminTestJSON-1934343982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:01:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-29f3c03b-e105-439a-a515-1c7af7ce384f tempest-VolumeQuotasAdminTestJSON-1934343982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:01:28 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-29f3c03b-e105-439a-a515-1c7af7ce384f tempest-VolumeQuotasAdminTestJSON-1934343982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:01:28 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-29f3c03b-e105-439a-a515-1c7af7ce384f tempest-VolumeQuotasAdminTestJSON-1934343982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:01:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-29f3c03b-e105-439a-a515-1c7af7ce384f tempest-VolumeQuotasAdminTestJSON-1934343982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:01:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-29f3c03b-e105-439a-a515-1c7af7ce384f tempest-VolumeQuotasAdminTestJSON-1934343982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:28 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:01:28 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:28 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-29f3c03b-e105-439a-a515-1c7af7ce384f tempest-VolumeQuotasAdminTestJSON-1934343982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.363s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:28 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-29f3c03b-e105-439a-a515-1c7af7ce384f tempest-VolumeQuotasAdminTestJSON-1934343982 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:01:28 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-29f3c03b-e105-439a-a515-1c7af7ce384f tempest-VolumeQuotasAdminTestJSON-1934343982 None] Deleted volume successfully. Sep 21 12:01:28 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-29f3c03b-e105-439a-a515-1c7af7ce384f tempest-VolumeQuotasAdminTestJSON-1934343982 None] Lock "cinder-75fd0972-2bef-45f5-9dbf-439a1306a79d-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:01:38 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:INSERT=47,cinder:UPDATE=186,cinder:SELECT=145,cinder:DELETE=10 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:01:38 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=157,cinder:INSERT=50,cinder:UPDATE=180,cinder:DELETE=9 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:01:42 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-faf56107-8ead-46df-b422-e37d7c9ff512 tempest-GroupsV314Test-1374989725 None] Group tempest-GroupsV314Test-Group-237136522: creating Sep 21 12:01:42 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-faf56107-8ead-46df-b422-e37d7c9ff512 tempest-GroupsV314Test-1374989725 None] Group tempest-GroupsV314Test-Group-237136522: created successfully Sep 21 12:01:42 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-faf56107-8ead-46df-b422-e37d7c9ff512 tempest-GroupsV314Test-1374989725 None] Create group completed successfully. Sep 21 12:01:44 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:01:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Flow 'volume_create_manager' (148bfb2a-bd44-40bc-9470-6e6b9ce5e40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:01:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7204bf44-6b7a-4c8a-9344-cfbff464779f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7204bf44-6b7a-4c8a-9344-cfbff464779f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-965911327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=79f4fb1a-27d7-4077-9228-e8256971b75e,host='devstack@QuobyteHD#QuobyteHD',id=c26e2cba-0f6e-426d-93da-06bb807f0b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d7961f0678c4216840118cbdbce826e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:01:45Z,use_quota=True,user_id='04f6c9bc3b3648968d87d4970e9876b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7efaf381-cb24-4685-a567-4c69417871ef),volume_type_id=7efaf381-cb24-4685-a567-4c69417871ef)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a6e2a9-ef0c-40e8-b39b-afd0859135e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a6e2a9-ef0c-40e8-b39b-afd0859135e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2353eee2-4d0b-4f3e-80e9-a91ade9a043b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2353eee2-4d0b-4f3e-80e9-a91ade9a043b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c26e2cba-0f6e-426d-93da-06bb807f0b64', 'volume_name': 'volume-c26e2cba-0f6e-426d-93da-06bb807f0b64', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f0c4e2-8e93-4ce7-96c8-080ab710b469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f0c4e2-8e93-4ce7-96c8-080ab710b469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (574c212e-a43b-4245-9cb9-92f5baf5cdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:44 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Volume c26e2cba-0f6e-426d-93da-06bb807f0b64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c26e2cba-0f6e-426d-93da-06bb807f0b64', 'volume_size': 1} Sep 21 12:01:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:01:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:01:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=79f4fb1a-27d7-4077-9228-e8256971b75e,created_at=2026-09-21T10:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-965911327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=79f4fb1a-27d7-4077-9228-e8256971b75e,host='devstack@QuobyteHD#QuobyteHD',id=c26e2cba-0f6e-426d-93da-06bb807f0b64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d7961f0678c4216840118cbdbce826e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:01:45Z,use_quota=True,user_id='04f6c9bc3b3648968d87d4970e9876b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7efaf381-cb24-4685-a567-4c69417871ef),volume_type_id=7efaf381-cb24-4685-a567-4c69417871ef)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:01:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Creating volume c26e2cba-0f6e-426d-93da-06bb807f0b64 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:01:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:01:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:01:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:01:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:01:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:01:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:01:44 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:01:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:44 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64 1073741824 Sep 21 12:01:44 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:45 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64 1073741824" returned: 0 in 0.662s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:45 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64 Sep 21 12:01:45 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:45 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:01:45 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Flow 'volume_create_manager' (d9d80bc1-9b32-40eb-8f6b-62c30dd3b90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:01:45 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:45 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25f34178-fd0e-404f-81d6-74cb08623e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64" returned: 0 in 0.381s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:01:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:01:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25f34178-fd0e-404f-81d6-74cb08623e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1123469870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=318415f7-d6e0-4e3c-b065-0eab7dd38888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1c0e48280914439a4f19f3b33dc5680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:01:46Z,use_quota=True,user_id='70340a42966b4450a6851cb792f23b7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1822b53-4f5d-4b67-8c53-eae839ead836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1822b53-4f5d-4b67-8c53-eae839ead836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e3414a-44ba-481d-bf47-77a9bc727631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e3414a-44ba-481d-bf47-77a9bc727631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '318415f7-d6e0-4e3c-b065-0eab7dd38888', 'volume_name': 'volume-318415f7-d6e0-4e3c-b065-0eab7dd38888', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee02f7bc-50aa-4456-87c9-660a0d41a549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee02f7bc-50aa-4456-87c9-660a0d41a549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96bfc8cd-5025-4043-8c37-1a91546e9849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:46 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Volume 318415f7-d6e0-4e3c-b065-0eab7dd38888: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-318415f7-d6e0-4e3c-b065-0eab7dd38888', 'volume_size': 1} Sep 21 12:01:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:01:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:01:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1123469870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=318415f7-d6e0-4e3c-b065-0eab7dd38888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1c0e48280914439a4f19f3b33dc5680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:01:46Z,use_quota=True,user_id='70340a42966b4450a6851cb792f23b7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:01:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Creating volume 318415f7-d6e0-4e3c-b065-0eab7dd38888 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:01:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:01:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:01:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:01:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:01:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:01:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:01:46 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:01:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-318415f7-d6e0-4e3c-b065-0eab7dd38888 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (574c212e-a43b-4245-9cb9-92f5baf5cdcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c26e2cba-0f6e-426d-93da-06bb807f0b64', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (902dd44b-41c9-4cd4-912d-1ed108b9bd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:46 devstack sudo[97903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-318415f7-d6e0-4e3c-b065-0eab7dd38888 1073741824 Sep 21 12:01:46 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:46 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Volume volume-c26e2cba-0f6e-426d-93da-06bb807f0b64 (c26e2cba-0f6e-426d-93da-06bb807f0b64): created successfully Sep 21 12:01:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (902dd44b-41c9-4cd4-912d-1ed108b9bd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Flow 'volume_create_manager' (148bfb2a-bd44-40bc-9470-6e6b9ce5e40f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:01:46 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-25a4f5ae-8efd-4b43-a081-61cbb66ba354 tempest-GroupsV314Test-1374989725 None] Created volume successfully. Sep 21 12:01:46 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-318415f7-d6e0-4e3c-b065-0eab7dd38888 1073741824" returned: 0 in 0.541s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-318415f7-d6e0-4e3c-b065-0eab7dd38888 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:46 devstack sudo[97909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-318415f7-d6e0-4e3c-b065-0eab7dd38888 Sep 21 12:01:46 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:46 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-318415f7-d6e0-4e3c-b065-0eab7dd38888" returned: 0 in 0.314s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:01:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:01:47 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96bfc8cd-5025-4043-8c37-1a91546e9849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-318415f7-d6e0-4e3c-b065-0eab7dd38888', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:47 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36792e59-8d9e-4acd-af40-6177b2e89448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:47 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Volume volume-318415f7-d6e0-4e3c-b065-0eab7dd38888 (318415f7-d6e0-4e3c-b065-0eab7dd38888): created successfully Sep 21 12:01:47 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36792e59-8d9e-4acd-af40-6177b2e89448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:47 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Flow 'volume_create_manager' (d9d80bc1-9b32-40eb-8f6b-62c30dd3b90a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:01:47 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-512d4a49-5018-443f-9f4c-646015e63f6b tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Created volume successfully. Sep 21 12:01:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:01:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.004s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:01:48 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Cloning volume c26e2cba-0f6e-426d-93da-06bb807f0b64 to volume 82a08a16-1ec9-48f7-b2c5-98810fc647e4 Sep 21 12:01:48 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Creating offline snapshot 7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89 of volume c26e2cba-0f6e-426d-93da-06bb807f0b64 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:01:48 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9879d8-392a-46ce-8fd1-718834691f96]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:01:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:48 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64 Sep 21 12:01:48 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:49 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64" returned: 0 in 0.592s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:49 devstack sudo[97918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89 1G Sep 21 12:01:49 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:49 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89 1G" returned: 0 in 0.667s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c26e2cba-0f6e-426d-93da-06bb807f0b64 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:49 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c26e2cba-0f6e-426d-93da-06bb807f0b64 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89 Sep 21 12:01:49 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5ee85ed9-e4f6-42f2-88eb-4d680c9b6252 tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Acquiring lock "cinder-318415f7-d6e0-4e3c-b065-0eab7dd38888-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:01:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5ee85ed9-e4f6-42f2-88eb-4d680c9b6252 tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Lock "cinder-318415f7-d6e0-4e3c-b065-0eab7dd38888-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:01:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5ee85ed9-e4f6-42f2-88eb-4d680c9b6252 tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Acquiring lock "cinder-quobyte-318415f7-d6e0-4e3c-b065-0eab7dd38888" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:01:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5ee85ed9-e4f6-42f2-88eb-4d680c9b6252 tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Lock "cinder-quobyte-318415f7-d6e0-4e3c-b065-0eab7dd38888" acquired by "delete_volume" :: waited 0.026s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:01:50 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cf05c4-d83b-4a11-b9ef-3b0d4b17ca84]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:01:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5ee85ed9-e4f6-42f2-88eb-4d680c9b6252 tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-318415f7-d6e0-4e3c-b065-0eab7dd38888 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:50 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c26e2cba-0f6e-426d-93da-06bb807f0b64 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89" returned: 0 in 0.408s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:50 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89 is being set with open permissions: ugo+rw: NotImplementedError Sep 21 12:01:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:50 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89 Sep 21 12:01:50 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:50 devstack sudo[97929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-318415f7-d6e0-4e3c-b065-0eab7dd38888 Sep 21 12:01:50 devstack sudo[97929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:50 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89" returned: 0 in 0.292s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:50 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.info Sep 21 12:01:50 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:50 devstack sudo[97929]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5ee85ed9-e4f6-42f2-88eb-4d680c9b6252 tempest-VolumeQuotasNegativeTestJSON-1873085051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-318415f7-d6e0-4e3c-b065-0eab7dd38888" returned: 0 in 0.565s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5ee85ed9-e4f6-42f2-88eb-4d680c9b6252 tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-318415f7-d6e0-4e3c-b065-0eab7dd38888 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:50 devstack sudo[97973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-318415f7-d6e0-4e3c-b065-0eab7dd38888 Sep 21 12:01:50 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:51 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5ee85ed9-e4f6-42f2-88eb-4d680c9b6252 tempest-VolumeQuotasNegativeTestJSON-1873085051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-318415f7-d6e0-4e3c-b065-0eab7dd38888" returned: 0 in 0.405s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:51 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5ee85ed9-e4f6-42f2-88eb-4d680c9b6252 tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Lock "cinder-quobyte-318415f7-d6e0-4e3c-b065-0eab7dd38888" released by "delete_volume" :: held 1.040s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:01:51 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.info" returned: 0 in 0.599s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:51 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.info is being set with open permissions: ugo+rw: NotImplementedError Sep 21 12:01:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:51 devstack sudo[97977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.info Sep 21 12:01:51 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:51 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-5ee85ed9-e4f6-42f2-88eb-4d680c9b6252 tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Created reservations ['ce740583-b6f2-42eb-b902-1748be5b86b4', 'a9a9c771-901a-484c-a145-1dc2c40e4bc7', '76cd9cde-48c1-46fd-9851-3436e56f7063', 'c8786312-d229-4d81-9bab-09e5f162d710'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:01:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5ee85ed9-e4f6-42f2-88eb-4d680c9b6252 tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:01:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5ee85ed9-e4f6-42f2-88eb-4d680c9b6252 tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:01:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5ee85ed9-e4f6-42f2-88eb-4d680c9b6252 tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:01:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5ee85ed9-e4f6-42f2-88eb-4d680c9b6252 tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:01:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5ee85ed9-e4f6-42f2-88eb-4d680c9b6252 tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:01:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5ee85ed9-e4f6-42f2-88eb-4d680c9b6252 tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:51 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:01:51 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:51 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.info" returned: 0 in 0.458s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:51 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Acquiring lock "cinder-quobyte-82a08a16-1ec9-48f7-b2c5-98810fc647e4" by "_copy_volume_from_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:01:51 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Lock "cinder-quobyte-82a08a16-1ec9-48f7-b2c5-98810fc647e4" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:01:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] snapshot: 7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89, volume: 82a08a16-1ec9-48f7-b2c5-98810fc647e4, {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 21 12:01:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:01:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:01:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:01:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:01:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:01:51 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[933912a7-2dd6-4a6e-8285-f49f2515d254]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:01:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:51 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5ee85ed9-e4f6-42f2-88eb-4d680c9b6252 tempest-VolumeQuotasNegativeTestJSON-1873085051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.438s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:51 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-5ee85ed9-e4f6-42f2-88eb-4d680c9b6252 tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:01:51 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-5ee85ed9-e4f6-42f2-88eb-4d680c9b6252 tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Deleted volume successfully. Sep 21 12:01:51 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5ee85ed9-e4f6-42f2-88eb-4d680c9b6252 tempest-VolumeQuotasNegativeTestJSON-1873085051 None] Lock "cinder-318415f7-d6e0-4e3c-b065-0eab7dd38888-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:01:51 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89 Sep 21 12:01:51 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:52 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89" returned: 0 in 0.454s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c26e2cba-0f6e-426d-93da-06bb807f0b64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:01:52 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[01577771-343e-4a38-818e-826709555441]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:01:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:52 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64 Sep 21 12:01:52 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:52 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Sep 21 12:01:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64" returned: 0 in 0.506s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:01:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64 {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 21 12:01:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Creating direct copy from snapshot {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 21 12:01:52 devstack cinder-volume[86366]: DEBUG cinder.utils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Path /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-82a08a16-1ec9-48f7-b2c5-98810fc647e4 not found in is_blk_device check {{(pid=86366) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 21 12:01:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-82a08a16-1ec9-48f7-b2c5-98810fc647e4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:01:52 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-82a08a16-1ec9-48f7-b2c5-98810fc647e4 Sep 21 12:01:52 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:01:54 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:01:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Flow 'volume_create_manager' (c741962e-48a4-43e4-a148-1fcbb26aa34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:01:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6ef8cd-6bb5-490a-8674-91da62735e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6ef8cd-6bb5-490a-8674-91da62735e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1442141190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2844fbed-b749-46f2-8d74-9c7a02d510e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00f6a957a05443e89ffafa755183f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:01:54Z,use_quota=True,user_id='65bd7ffff6f342a7af464d2207fc650c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e0393ab-cb1e-4aa2-baa4-ea9fcf18f74e),volume_type_id=7e0393ab-cb1e-4aa2-baa4-ea9fcf18f74e)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ac2387-9cc2-4a43-88d0-ccb2ef48f6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ac2387-9cc2-4a43-88d0-ccb2ef48f6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1033d7aa-9b0b-4c84-a72c-ba1a493b1f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1033d7aa-9b0b-4c84-a72c-ba1a493b1f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2844fbed-b749-46f2-8d74-9c7a02d510e7', 'volume_name': 'volume-2844fbed-b749-46f2-8d74-9c7a02d510e7', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e63b01e6-0374-4d69-a80b-7e36f177fad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e63b01e6-0374-4d69-a80b-7e36f177fad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de429c3-f978-4d46-80d3-33036ad80b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:54 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Volume 2844fbed-b749-46f2-8d74-9c7a02d510e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2844fbed-b749-46f2-8d74-9c7a02d510e7', 'volume_size': 1} Sep 21 12:01:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:01:55 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:01:55 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Flow 'volume_create_manager' (763018c2-dad7-48a4-9101-e35810d239aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:01:55 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2124c96f-bd08-48f3-b8f4-b65e310b0322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:55 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2124c96f-bd08-48f3-b8f4-b65e310b0322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1791850414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cea9e23-0d1a-460f-9034-335eb9cf0a31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00f6a957a05443e89ffafa755183f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:01:55Z,use_quota=True,user_id='65bd7ffff6f342a7af464d2207fc650c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(287d8371-6531-4431-b5df-ab12294daed9),volume_type_id=287d8371-6531-4431-b5df-ab12294daed9)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:55 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff879299-258a-4857-b5f8-81f58fb35c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:55 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff879299-258a-4857-b5f8-81f58fb35c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:55 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f0c5b64-e5bc-4828-a20e-5cc2201aac16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:55 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f0c5b64-e5bc-4828-a20e-5cc2201aac16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cea9e23-0d1a-460f-9034-335eb9cf0a31', 'volume_name': 'volume-3cea9e23-0d1a-460f-9034-335eb9cf0a31', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:55 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7163db42-c7b9-4bbd-8fb5-6da398fa4fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:55 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7163db42-c7b9-4bbd-8fb5-6da398fa4fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:55 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f071104-5cff-4462-91ba-130dd9c5c4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:55 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Volume 3cea9e23-0d1a-460f-9034-335eb9cf0a31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cea9e23-0d1a-460f-9034-335eb9cf0a31', 'volume_size': 1} Sep 21 12:01:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:01:56 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:01:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Flow 'volume_create_manager' (5c236afc-71ee-4e04-9255-7f423f0caad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:01:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed66758-712f-43e8-9baa-92396341b11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ed66758-712f-43e8-9baa-92396341b11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-324292701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00f6a957a05443e89ffafa755183f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:01:56Z,use_quota=True,user_id='65bd7ffff6f342a7af464d2207fc650c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7ee137b-1f7e-472b-a4c8-03cac670be1f),volume_type_id=d7ee137b-1f7e-472b-a4c8-03cac670be1f)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe7aaa8-a47b-4e41-af6f-b261a4f98353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe7aaa8-a47b-4e41-af6f-b261a4f98353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f8edae-50ab-4f18-acba-73e115777e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:56 devstack cinder-volume[86366]: DEBUG cinder.image.glance [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Creating Keystone auth plugin from conf {{(pid=86366) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 21 12:01:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75f8edae-50ab-4f18-acba-73e115777e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6', 'volume_name': 'volume-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6', 'volume_size': 1, 'image_id': 'b550f762-ce73-420d-8a2c-5d2dc3424388', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b550f762-ce73-420d-8a2c-5d2dc3424388', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--507287421', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b00f6a957a05443e89ffafa755183f29', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b550f762-ce73-420d-8a2c-5d2dc3424388', 'created_at': datetime.datetime(2026, 9, 21, 10, 1, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 10, 1, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b550f762-ce73-420d-8a2c-5d2dc3424388/file', 'properties': {}}, 'image_service': }' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b79ce027-cb35-4dcf-8910-279467727880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b79ce027-cb35-4dcf-8910-279467727880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:01:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02aedacc-1a55-4fa8-9012-2887ef3d2276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:01:57 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Volume da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6', 'volume_size': 1, 'image_id': 'b550f762-ce73-420d-8a2c-5d2dc3424388', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b550f762-ce73-420d-8a2c-5d2dc3424388', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--507287421', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b00f6a957a05443e89ffafa755183f29', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b550f762-ce73-420d-8a2c-5d2dc3424388', 'created_at': datetime.datetime(2026, 9, 21, 10, 1, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 10, 1, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b550f762-ce73-420d-8a2c-5d2dc3424388/file', 'properties': {}}, 'image_service': } Sep 21 12:01:57 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Trying to clone da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6 from image b550f762-ce73-420d-8a2c-5d2dc3424388 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b550f762-ce73-420d-8a2c-5d2dc3424388', 'metadata': {}}]). {{(pid=86366) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 21 12:02:02 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-82a08a16-1ec9-48f7-b2c5-98810fc647e4" returned: 0 in 10.001s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:02 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Image conversion details: src /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64, size 1024.00 MB, duration 10.00 sec, destination /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-82a08a16-1ec9-48f7-b2c5-98810fc647e4 {{(pid=86366) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 12:02:02 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Converted 1024.00 MB image at 102.37 MB/s Sep 21 12:02:02 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-82a08a16-1ec9-48f7-b2c5-98810fc647e4 is being set with open permissions: ugo+rw: NotImplementedError Sep 21 12:02:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-82a08a16-1ec9-48f7-b2c5-98810fc647e4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:02 devstack sudo[98018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-82a08a16-1ec9-48f7-b2c5-98810fc647e4 Sep 21 12:02:02 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:02 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-82a08a16-1ec9-48f7-b2c5-98810fc647e4" returned: 0 in 0.334s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:03 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Lock "cinder-quobyte-82a08a16-1ec9-48f7-b2c5-98810fc647e4" released by "_copy_volume_from_snapshot" :: held 11.418s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:02:03 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Acquiring lock "cinder-quobyte-7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:02:03 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Lock "cinder-quobyte-7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:02:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Deleting offline snapshot 7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89 of volume c26e2cba-0f6e-426d-93da-06bb807f0b64 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:02:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] snapshot_file for this snap is: volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:02:03 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfae172-fece-4fb7-9725-d15cc87e209e]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:02:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:03 devstack sudo[98021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89 Sep 21 12:02:03 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:03 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89" returned: 0 in 0.453s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c26e2cba-0f6e-426d-93da-06bb807f0b64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:02:03 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7b5656-40bc-4735-b252-a334c84a30c2]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:02:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:03 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 12:02:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:02:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:02:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:02:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:02:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:02:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:03 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:02:03 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:03 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64 Sep 21 12:02:03 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:04 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.374s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:04 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:02:04 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b550f762-ce73-420d-8a2c-5d2dc3424388_iut05w1idevstack@QuobyteHD, size 20.69 MB, duration 6.37 sec {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 21 12:02:04 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Image download 20.69 MB at 3.25 MB/s Sep 21 12:02:04 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 12:02:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread count: 28 {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 12:02:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread info: [<_MainThread(MainThread, started 132841976594560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 12:02:04 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bf279f-341a-4214-9116-dc83f30045ad]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:02:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b550f762-ce73-420d-8a2c-5d2dc3424388_iut05w1idevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:04 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b550f762-ce73-420d-8a2c-5d2dc3424388_iut05w1idevstack@QuobyteHD Sep 21 12:02:04 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:04 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64" returned: 0 in 0.785s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:04 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89 Sep 21 12:02:04 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:04 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b550f762-ce73-420d-8a2c-5d2dc3424388_iut05w1idevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:04 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Temporary image b550f762-ce73-420d-8a2c-5d2dc3424388 is fetched for user 65bd7ffff6f342a7af464d2207fc650c. {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 21 12:02:04 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[271a2540-666e-4985-8326-b4b854eaf3da]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:02:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b550f762-ce73-420d-8a2c-5d2dc3424388_iut05w1idevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:04 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b550f762-ce73-420d-8a2c-5d2dc3424388_iut05w1idevstack@QuobyteHD Sep 21 12:02:04 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:04 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89" returned: 0 in 0.503s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:04 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89 Sep 21 12:02:04 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:05 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Flow 'volume_create_manager' (e604ca94-4998-4670-bbe9-5280c2672504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (176fb363-4b41-4e60-9c68-59330a6414eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b550f762-ce73-420d-8a2c-5d2dc3424388_iut05w1idevstack@QuobyteHD" returned: 0 in 0.549s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (176fb363-4b41-4e60-9c68-59330a6414eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1029069683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb30fdc-5616-48b8-a396-6ce808516cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c13ba6ebc1340e6ac4c51a0fe140938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:02:05Z,use_quota=True,user_id='2bc109850fc54707b2c60404350710eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (015aa448-73c7-4d98-8cc4-37ffef1d42ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (015aa448-73c7-4d98-8cc4-37ffef1d42ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d11355b0-9a78-47f8-9824-ce3e14ba5691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d11355b0-9a78-47f8-9824-ce3e14ba5691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efb30fdc-5616-48b8-a396-6ce808516cc5', 'volume_name': 'volume-efb30fdc-5616-48b8-a396-6ce808516cc5', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10334e5c-d381-44d0-9cd1-163545755528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10334e5c-d381-44d0-9cd1-163545755528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99357cab-7405-4343-8bb1-fd01adababf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:02:05 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Volume efb30fdc-5616-48b8-a396-6ce808516cc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efb30fdc-5616-48b8-a396-6ce808516cc5', 'volume_size': 1} Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:02:05 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64.7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89" returned: 0 in 0.331s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Lock "cinder-quobyte-7d9dbcca-fc4f-4fe3-a4bb-3c7bb7e84b89" released by "_delete_snapshot" :: held 2.201s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.981s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.026s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1442141190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2844fbed-b749-46f2-8d74-9c7a02d510e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00f6a957a05443e89ffafa755183f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:01:54Z,use_quota=True,user_id='65bd7ffff6f342a7af464d2207fc650c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e0393ab-cb1e-4aa2-baa4-ea9fcf18f74e),volume_type_id=7e0393ab-cb1e-4aa2-baa4-ea9fcf18f74e)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Creating volume 2844fbed-b749-46f2-8d74-9c7a02d510e7 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:02:05 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2844fbed-b749-46f2-8d74-9c7a02d510e7 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:05 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2844fbed-b749-46f2-8d74-9c7a02d510e7 1073741824 Sep 21 12:02:05 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:05 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1354536d-df66-4f4d-8bdf-1d28b7cb464b tempest-GroupsV314Test-1374989725 None] Create group from source-group-79f4fb1a-27d7-4077-9228-e8256971b75e completed successfully. Sep 21 12:02:05 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2844fbed-b749-46f2-8d74-9c7a02d510e7 1073741824" returned: 0 in 0.483s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2844fbed-b749-46f2-8d74-9c7a02d510e7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:05 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2844fbed-b749-46f2-8d74-9c7a02d510e7 Sep 21 12:02:05 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:06 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2844fbed-b749-46f2-8d74-9c7a02d510e7" returned: 0 in 0.295s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:06 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:02:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:02:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.628s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:02:06 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1791850414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cea9e23-0d1a-460f-9034-335eb9cf0a31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00f6a957a05443e89ffafa755183f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:01:55Z,use_quota=True,user_id='65bd7ffff6f342a7af464d2207fc650c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(287d8371-6531-4431-b5df-ab12294daed9),volume_type_id=287d8371-6531-4431-b5df-ab12294daed9)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:02:06 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Creating volume 3cea9e23-0d1a-460f-9034-335eb9cf0a31 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:02:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:02:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:02:06 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:02:06 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:02:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:02:06 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:02:06 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:02:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3cea9e23-0d1a-460f-9034-335eb9cf0a31 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:06 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de429c3-f978-4d46-80d3-33036ad80b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2844fbed-b749-46f2-8d74-9c7a02d510e7', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:02:06 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3cea9e23-0d1a-460f-9034-335eb9cf0a31 1073741824 Sep 21 12:02:06 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:06 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7345728-adb5-4684-897b-d9e98d436e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:02:06 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Volume volume-2844fbed-b749-46f2-8d74-9c7a02d510e7 (2844fbed-b749-46f2-8d74-9c7a02d510e7): created successfully Sep 21 12:02:06 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7345728-adb5-4684-897b-d9e98d436e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:02:06 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Flow 'volume_create_manager' (c741962e-48a4-43e4-a148-1fcbb26aa34b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:02:06 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-0cc358df-c758-46d3-961e-71a2a9a3e974 tempest-TestInstancesWithCinderVolumes-1667789699 None] Created volume successfully. Sep 21 12:02:06 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c72d978d-7465-4b24-834a-5053cc9ee5da tempest-GroupsV314Test-1374989725 None] Acquiring lock "cinder-quobyte-82a08a16-1ec9-48f7-b2c5-98810fc647e4" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:02:06 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c72d978d-7465-4b24-834a-5053cc9ee5da tempest-GroupsV314Test-1374989725 None] Lock "cinder-quobyte-82a08a16-1ec9-48f7-b2c5-98810fc647e4" acquired by "delete_volume" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:02:06 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[09757e84-2a17-4170-8c84-61fff0001308]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:02:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c72d978d-7465-4b24-834a-5053cc9ee5da tempest-GroupsV314Test-1374989725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-82a08a16-1ec9-48f7-b2c5-98810fc647e4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:06 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-82a08a16-1ec9-48f7-b2c5-98810fc647e4 Sep 21 12:02:06 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:06 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3cea9e23-0d1a-460f-9034-335eb9cf0a31 1073741824" returned: 0 in 0.572s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3cea9e23-0d1a-460f-9034-335eb9cf0a31 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:06 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3cea9e23-0d1a-460f-9034-335eb9cf0a31 Sep 21 12:02:06 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:06 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c72d978d-7465-4b24-834a-5053cc9ee5da tempest-GroupsV314Test-1374989725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-82a08a16-1ec9-48f7-b2c5-98810fc647e4" returned: 0 in 0.422s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c72d978d-7465-4b24-834a-5053cc9ee5da tempest-GroupsV314Test-1374989725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-82a08a16-1ec9-48f7-b2c5-98810fc647e4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:06 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-82a08a16-1ec9-48f7-b2c5-98810fc647e4 Sep 21 12:02:06 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:07 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3cea9e23-0d1a-460f-9034-335eb9cf0a31" returned: 0 in 0.275s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.880s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-324292701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b00f6a957a05443e89ffafa755183f29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:01:56Z,use_quota=True,user_id='65bd7ffff6f342a7af464d2207fc650c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7ee137b-1f7e-472b-a4c8-03cac670be1f),volume_type_id=d7ee137b-1f7e-472b-a4c8-03cac670be1f)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Creating volume da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:02:07 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f071104-5cff-4462-91ba-130dd9c5c4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cea9e23-0d1a-460f-9034-335eb9cf0a31', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:02:07 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6 1073741824 Sep 21 12:02:07 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (631a79ff-834f-49de-8745-510253413b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:02:07 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Volume volume-3cea9e23-0d1a-460f-9034-335eb9cf0a31 (3cea9e23-0d1a-460f-9034-335eb9cf0a31): created successfully Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (631a79ff-834f-49de-8745-510253413b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Flow 'volume_create_manager' (763018c2-dad7-48a4-9101-e35810d239aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:02:07 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-7af31607-3a51-4d1d-9736-5d86038aa56d tempest-TestInstancesWithCinderVolumes-1667789699 None] Created volume successfully. Sep 21 12:02:07 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c72d978d-7465-4b24-834a-5053cc9ee5da tempest-GroupsV314Test-1374989725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-82a08a16-1ec9-48f7-b2c5-98810fc647e4" returned: 0 in 0.303s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c72d978d-7465-4b24-834a-5053cc9ee5da tempest-GroupsV314Test-1374989725 None] Lock "cinder-quobyte-82a08a16-1ec9-48f7-b2c5-98810fc647e4" released by "delete_volume" :: held 0.777s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-c72d978d-7465-4b24-834a-5053cc9ee5da tempest-GroupsV314Test-1374989725 None] Created reservations ['911ff3af-add0-4154-a963-e95f2fe3913a'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:02:07 devstack cinder-volume[86366]: WARNING cinder.quota [None req-c72d978d-7465-4b24-834a-5053cc9ee5da tempest-GroupsV314Test-1374989725 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1189972527 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1189972527, it is now deprecated. Please use the default quota class for default quota. Sep 21 12:02:07 devstack cinder-volume[86366]: WARNING cinder.quota [None req-c72d978d-7465-4b24-834a-5053cc9ee5da tempest-GroupsV314Test-1374989725 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1189972527 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1189972527, it is now deprecated. Please use the default quota class for default quota. Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-c72d978d-7465-4b24-834a-5053cc9ee5da tempest-GroupsV314Test-1374989725 None] Created reservations ['9c160524-c4f1-49bb-99ed-71efe26ed7ea', 'a5d5b631-c26b-473c-a475-8f6b2b7d6ac6', '997ed531-7ac8-4ebb-8bed-866dc2f5ebd9', '279b5543-20e6-46af-9292-6e6842128fac'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c72d978d-7465-4b24-834a-5053cc9ee5da tempest-GroupsV314Test-1374989725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c72d978d-7465-4b24-834a-5053cc9ee5da tempest-GroupsV314Test-1374989725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c72d978d-7465-4b24-834a-5053cc9ee5da tempest-GroupsV314Test-1374989725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c72d978d-7465-4b24-834a-5053cc9ee5da tempest-GroupsV314Test-1374989725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c72d978d-7465-4b24-834a-5053cc9ee5da tempest-GroupsV314Test-1374989725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c72d978d-7465-4b24-834a-5053cc9ee5da tempest-GroupsV314Test-1374989725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:07 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:02:07 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:07 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6 1073741824" returned: 0 in 0.584s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:07 devstack sudo[98089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6 Sep 21 12:02:07 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:07 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c72d978d-7465-4b24-834a-5053cc9ee5da tempest-GroupsV314Test-1374989725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.321s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-c72d978d-7465-4b24-834a-5053cc9ee5da tempest-GroupsV314Test-1374989725 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:02:07 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-c72d978d-7465-4b24-834a-5053cc9ee5da tempest-GroupsV314Test-1374989725 None] Delete group completed successfully. Sep 21 12:02:07 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6" returned: 0 in 0.281s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.768s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1029069683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb30fdc-5616-48b8-a396-6ce808516cc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c13ba6ebc1340e6ac4c51a0fe140938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:02:05Z,use_quota=True,user_id='2bc109850fc54707b2c60404350710eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Creating volume efb30fdc-5616-48b8-a396-6ce808516cc5 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:02:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:02:08 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:02:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:02:08 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:02:08 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:02:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-efb30fdc-5616-48b8-a396-6ce808516cc5 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:08 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4c32ecce-94f5-4e45-9257-fc176740bb7a tempest-GroupsV314Test-1374989725 None] Acquiring lock "cinder-quobyte-c26e2cba-0f6e-426d-93da-06bb807f0b64" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:02:08 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4c32ecce-94f5-4e45-9257-fc176740bb7a tempest-GroupsV314Test-1374989725 None] Lock "cinder-quobyte-c26e2cba-0f6e-426d-93da-06bb807f0b64" acquired by "delete_volume" :: waited 0.031s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:02:08 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-efb30fdc-5616-48b8-a396-6ce808516cc5 1073741824 Sep 21 12:02:08 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:08 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Attempting download of b550f762-ce73-420d-8a2c-5d2dc3424388 ((None, [{'url': 'file:///opt/stack/data/glance/images/b550f762-ce73-420d-8a2c-5d2dc3424388', 'metadata': {}}])) to volume da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6. {{(pid=86366) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 21 12:02:08 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fe71dc-7fcc-4e93-941f-a4eeb7bb3fc3]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:02:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4c32ecce-94f5-4e45-9257-fc176740bb7a tempest-GroupsV314Test-1374989725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:08 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc3cac5-0cf9-47b7-a6e2-a6cf277018cd]: (4, 'raw') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:02:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b550f762-ce73-420d-8a2c-5d2dc3424388_0owjaxe0 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:08 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b550f762-ce73-420d-8a2c-5d2dc3424388_0owjaxe0 Sep 21 12:02:08 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:08 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64 Sep 21 12:02:08 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:08 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:08 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-efb30fdc-5616-48b8-a396-6ce808516cc5 1073741824" returned: 0 in 0.638s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b550f762-ce73-420d-8a2c-5d2dc3424388_0owjaxe0" returned: 0 in 0.414s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b550f762-ce73-420d-8a2c-5d2dc3424388_0owjaxe0 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:08 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4c32ecce-94f5-4e45-9257-fc176740bb7a tempest-GroupsV314Test-1374989725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64" returned: 0 in 0.511s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4c32ecce-94f5-4e45-9257-fc176740bb7a tempest-GroupsV314Test-1374989725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:08 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64 Sep 21 12:02:08 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-efb30fdc-5616-48b8-a396-6ce808516cc5 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:08 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-efb30fdc-5616-48b8-a396-6ce808516cc5 Sep 21 12:02:08 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:08 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b550f762-ce73-420d-8a2c-5d2dc3424388_0owjaxe0 Sep 21 12:02:08 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:08 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4c32ecce-94f5-4e45-9257-fc176740bb7a tempest-GroupsV314Test-1374989725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c26e2cba-0f6e-426d-93da-06bb807f0b64" returned: 0 in 0.323s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4c32ecce-94f5-4e45-9257-fc176740bb7a tempest-GroupsV314Test-1374989725 None] Lock "cinder-quobyte-c26e2cba-0f6e-426d-93da-06bb807f0b64" released by "delete_volume" :: held 0.973s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:02:09 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:09 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-efb30fdc-5616-48b8-a396-6ce808516cc5" returned: 0 in 0.319s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b550f762-ce73-420d-8a2c-5d2dc3424388_0owjaxe0" returned: 1 in 0.405s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b550f762-ce73-420d-8a2c-5d2dc3424388_0owjaxe0' failed. Not Retrying. {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[32218dea-6c6d-441c-90e2-cb03604da56b]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b550f762-ce73-420d-8a2c-5d2dc3424388_iut05w1idevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99357cab-7405-4343-8bb1-fd01adababf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efb30fdc-5616-48b8-a396-6ce808516cc5', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7503ebb5-44de-4173-998a-827fffe99467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:02:09 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Volume volume-efb30fdc-5616-48b8-a396-6ce808516cc5 (efb30fdc-5616-48b8-a396-6ce808516cc5): created successfully Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7503ebb5-44de-4173-998a-827fffe99467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Flow 'volume_create_manager' (e604ca94-4998-4670-bbe9-5280c2672504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:02:09 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-5f9c3cfb-979d-40ea-b635-9650a4bd5b6d tempest-VolumesServicesTestJSON-1468443917 None] Created volume successfully. Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-4c32ecce-94f5-4e45-9257-fc176740bb7a tempest-GroupsV314Test-1374989725 None] Created reservations ['053b8e58-495d-4423-b864-92f29f7f8894'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:02:09 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b550f762-ce73-420d-8a2c-5d2dc3424388_iut05w1idevstack@QuobyteHD Sep 21 12:02:09 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-4c32ecce-94f5-4e45-9257-fc176740bb7a tempest-GroupsV314Test-1374989725 None] Created reservations ['1a1a204c-aff8-46f9-9711-aa71f021dbc8', '449145e4-fd15-4e5e-b0ca-4020c44aca53', '508b8853-813a-41f6-84e8-459e226ff3a1', '6e53f26f-e9e7-4651-a27c-31f1bee01006'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4c32ecce-94f5-4e45-9257-fc176740bb7a tempest-GroupsV314Test-1374989725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4c32ecce-94f5-4e45-9257-fc176740bb7a tempest-GroupsV314Test-1374989725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4c32ecce-94f5-4e45-9257-fc176740bb7a tempest-GroupsV314Test-1374989725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4c32ecce-94f5-4e45-9257-fc176740bb7a tempest-GroupsV314Test-1374989725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4c32ecce-94f5-4e45-9257-fc176740bb7a tempest-GroupsV314Test-1374989725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4c32ecce-94f5-4e45-9257-fc176740bb7a tempest-GroupsV314Test-1374989725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:09 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:02:09 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:09 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b550f762-ce73-420d-8a2c-5d2dc3424388_iut05w1idevstack@QuobyteHD" returned: 0 in 0.478s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] b550f762-ce73-420d-8a2c-5d2dc3424388 was qcow2, converting to qcow2 {{(pid=86366) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b550f762-ce73-420d-8a2c-5d2dc3424388_iut05w1idevstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:09 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b550f762-ce73-420d-8a2c-5d2dc3424388_iut05w1idevstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6 Sep 21 12:02:09 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e1771ff0-75d7-4a7e-879f-a7a3025d91a6 tempest-VolumesServicesTestJSON-1468443917 None] Acquiring lock "cinder-efb30fdc-5616-48b8-a396-6ce808516cc5-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:02:09 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e1771ff0-75d7-4a7e-879f-a7a3025d91a6 tempest-VolumesServicesTestJSON-1468443917 None] Lock "cinder-efb30fdc-5616-48b8-a396-6ce808516cc5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4c32ecce-94f5-4e45-9257-fc176740bb7a tempest-GroupsV314Test-1374989725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.363s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-4c32ecce-94f5-4e45-9257-fc176740bb7a tempest-GroupsV314Test-1374989725 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:02:09 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-4c32ecce-94f5-4e45-9257-fc176740bb7a tempest-GroupsV314Test-1374989725 None] Delete group completed successfully. Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e1771ff0-75d7-4a7e-879f-a7a3025d91a6 tempest-VolumesServicesTestJSON-1468443917 None] Acquiring lock "cinder-quobyte-efb30fdc-5616-48b8-a396-6ce808516cc5" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e1771ff0-75d7-4a7e-879f-a7a3025d91a6 tempest-VolumesServicesTestJSON-1468443917 None] Lock "cinder-quobyte-efb30fdc-5616-48b8-a396-6ce808516cc5" acquired by "delete_volume" :: waited 0.017s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9e4939-5298-4ac5-af0f-df83bd7219fe]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:02:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e1771ff0-75d7-4a7e-879f-a7a3025d91a6 tempest-VolumesServicesTestJSON-1468443917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-efb30fdc-5616-48b8-a396-6ce808516cc5 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:09 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-efb30fdc-5616-48b8-a396-6ce808516cc5 Sep 21 12:02:09 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:10 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e1771ff0-75d7-4a7e-879f-a7a3025d91a6 tempest-VolumesServicesTestJSON-1468443917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-efb30fdc-5616-48b8-a396-6ce808516cc5" returned: 0 in 0.555s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e1771ff0-75d7-4a7e-879f-a7a3025d91a6 tempest-VolumesServicesTestJSON-1468443917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-efb30fdc-5616-48b8-a396-6ce808516cc5 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:10 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-efb30fdc-5616-48b8-a396-6ce808516cc5 Sep 21 12:02:10 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:10 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e1771ff0-75d7-4a7e-879f-a7a3025d91a6 tempest-VolumesServicesTestJSON-1468443917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-efb30fdc-5616-48b8-a396-6ce808516cc5" returned: 0 in 0.469s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:10 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e1771ff0-75d7-4a7e-879f-a7a3025d91a6 tempest-VolumesServicesTestJSON-1468443917 None] Lock "cinder-quobyte-efb30fdc-5616-48b8-a396-6ce808516cc5" released by "delete_volume" :: held 1.108s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:02:11 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-e1771ff0-75d7-4a7e-879f-a7a3025d91a6 tempest-VolumesServicesTestJSON-1468443917 None] Created reservations ['561a6ef9-fe65-42ae-909a-3317662158c5', 'd0dff799-3f18-424e-abfb-bde32472bbb5', 'd1a8180d-acc7-4b4c-ab8d-fc09642c9eaa', '0f4511cd-d899-4ef7-92ba-e7ab313046d2'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:02:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e1771ff0-75d7-4a7e-879f-a7a3025d91a6 tempest-VolumesServicesTestJSON-1468443917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:02:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e1771ff0-75d7-4a7e-879f-a7a3025d91a6 tempest-VolumesServicesTestJSON-1468443917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:02:11 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e1771ff0-75d7-4a7e-879f-a7a3025d91a6 tempest-VolumesServicesTestJSON-1468443917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:02:11 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e1771ff0-75d7-4a7e-879f-a7a3025d91a6 tempest-VolumesServicesTestJSON-1468443917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:02:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e1771ff0-75d7-4a7e-879f-a7a3025d91a6 tempest-VolumesServicesTestJSON-1468443917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:02:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e1771ff0-75d7-4a7e-879f-a7a3025d91a6 tempest-VolumesServicesTestJSON-1468443917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:11 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:02:11 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:11 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e1771ff0-75d7-4a7e-879f-a7a3025d91a6 tempest-VolumesServicesTestJSON-1468443917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.345s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:11 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-e1771ff0-75d7-4a7e-879f-a7a3025d91a6 tempest-VolumesServicesTestJSON-1468443917 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:02:11 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-e1771ff0-75d7-4a7e-879f-a7a3025d91a6 tempest-VolumesServicesTestJSON-1468443917 None] Deleted volume successfully. Sep 21 12:02:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e1771ff0-75d7-4a7e-879f-a7a3025d91a6 tempest-VolumesServicesTestJSON-1468443917 None] Lock "cinder-efb30fdc-5616-48b8-a396-6ce808516cc5-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:02:12 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b550f762-ce73-420d-8a2c-5d2dc3424388_iut05w1idevstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6" returned: 0 in 3.000s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:12 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b550f762-ce73-420d-8a2c-5d2dc3424388_iut05w1idevstack@QuobyteHD, size 112.00 MB, duration 3.00 sec, destination /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6 {{(pid=86366) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 12:02:12 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Converted 112.00 MB image at 37.32 MB/s Sep 21 12:02:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:12 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6 1G Sep 21 12:02:12 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:12 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6 1G" returned: 0 in 0.444s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:12 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Downloaded image b550f762-ce73-420d-8a2c-5d2dc3424388 ((None, [{'url': 'file:///opt/stack/data/glance/images/b550f762-ce73-420d-8a2c-5d2dc3424388', 'metadata': {}}])) to volume da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6 successfully. {{(pid=86366) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 21 12:02:13 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Temporary image b550f762-ce73-420d-8a2c-5d2dc3424388 for user 65bd7ffff6f342a7af464d2207fc650c is deleted. {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 21 12:02:13 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Marking volume da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6 as bootable. {{(pid=86366) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 21 12:02:13 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Copying metadata from image b550f762-ce73-420d-8a2c-5d2dc3424388 to da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6. {{(pid=86366) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 21 12:02:13 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Creating volume glance metadata for volume da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6 backed by image b550f762-ce73-420d-8a2c-5d2dc3424388 with: {'image_id': 'b550f762-ce73-420d-8a2c-5d2dc3424388', 'image_name': 'tempest-scenario-img--507287421', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86366) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 21 12:02:13 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02aedacc-1a55-4fa8-9012-2887ef3d2276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6', 'volume_size': 1, 'image_id': 'b550f762-ce73-420d-8a2c-5d2dc3424388', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b550f762-ce73-420d-8a2c-5d2dc3424388', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--507287421', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b00f6a957a05443e89ffafa755183f29', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b550f762-ce73-420d-8a2c-5d2dc3424388', 'created_at': datetime.datetime(2026, 9, 21, 10, 1, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 10, 1, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b550f762-ce73-420d-8a2c-5d2dc3424388/file', 'properties': {}}, 'image_service': }' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:02:13 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed09333-cc8b-423a-975a-be932fc7cd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:02:13 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Volume volume-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6 (da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6): created successfully Sep 21 12:02:13 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed09333-cc8b-423a-975a-be932fc7cd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:02:13 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Flow 'volume_create_manager' (5c236afc-71ee-4e04-9255-7f423f0caad9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:02:13 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-4295da09-3c96-4438-8a48-f4645bb1e5d0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Created volume successfully. Sep 21 12:02:19 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:02:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Flow 'volume_create_manager' (2c0d8f07-1e94-4317-92a1-b351079b8bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:02:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5414ecea-3371-4cc2-900f-78e481a3a578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:02:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5414ecea-3371-4cc2-900f-78e481a3a578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1839321557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc58c30e-67c4-4aff-a3a0-729aeb4c9dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d7aea23b7442379acc0922699d5a70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:02:19Z,use_quota=True,user_id='459fb38b623049828bc763b22ae8073b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:02:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa7b599e-178a-46e7-a33d-bcda3cfcd1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:02:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa7b599e-178a-46e7-a33d-bcda3cfcd1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:02:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e5ae86-6e5b-4880-a961-49af30ea9bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:02:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e5ae86-6e5b-4880-a961-49af30ea9bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc58c30e-67c4-4aff-a3a0-729aeb4c9dab', 'volume_name': 'volume-cc58c30e-67c4-4aff-a3a0-729aeb4c9dab', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:02:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0475beaf-dae7-41d3-93a5-f6f3200d8c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:02:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0475beaf-dae7-41d3-93a5-f6f3200d8c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:02:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4342a413-55e3-4e67-9af1-99985d43e0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:02:19 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Volume cc58c30e-67c4-4aff-a3a0-729aeb4c9dab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc58c30e-67c4-4aff-a3a0-729aeb4c9dab', 'volume_size': 1} Sep 21 12:02:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:02:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:02:19 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1839321557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc58c30e-67c4-4aff-a3a0-729aeb4c9dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23d7aea23b7442379acc0922699d5a70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:02:19Z,use_quota=True,user_id='459fb38b623049828bc763b22ae8073b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:02:19 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Creating volume cc58c30e-67c4-4aff-a3a0-729aeb4c9dab {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:02:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:02:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:02:19 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:02:19 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:02:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:02:19 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:02:19 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:02:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-cc58c30e-67c4-4aff-a3a0-729aeb4c9dab 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:19 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-cc58c30e-67c4-4aff-a3a0-729aeb4c9dab 1073741824 Sep 21 12:02:19 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:20 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-cc58c30e-67c4-4aff-a3a0-729aeb4c9dab 1073741824" returned: 0 in 0.725s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-cc58c30e-67c4-4aff-a3a0-729aeb4c9dab {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:20 devstack sudo[98270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-cc58c30e-67c4-4aff-a3a0-729aeb4c9dab Sep 21 12:02:20 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:21 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-cc58c30e-67c4-4aff-a3a0-729aeb4c9dab" returned: 0 in 0.541s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:21 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:02:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:02:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4342a413-55e3-4e67-9af1-99985d43e0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc58c30e-67c4-4aff-a3a0-729aeb4c9dab', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:02:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf19a28-dd93-4e25-81f8-a506ff1c975f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:02:21 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Volume volume-cc58c30e-67c4-4aff-a3a0-729aeb4c9dab (cc58c30e-67c4-4aff-a3a0-729aeb4c9dab): created successfully Sep 21 12:02:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf19a28-dd93-4e25-81f8-a506ff1c975f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:02:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Flow 'volume_create_manager' (2c0d8f07-1e94-4317-92a1-b351079b8bb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:02:21 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-da6aad90-6aeb-4fdf-9124-a79eb8035d23 tempest-TestMinimumBasicScenario-1727933180 None] Created volume successfully. Sep 21 12:02:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-4169d490-043a-4d0c-af28-c5652fbad96b req-09c0ee6a-c9d7-4728-917c-d9407ad21944 tempest-TestInstancesWithCinderVolumes-1667789699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:02:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-4169d490-043a-4d0c-af28-c5652fbad96b req-09c0ee6a-c9d7-4728-917c-d9407ad21944 tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:02:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-4169d490-043a-4d0c-af28-c5652fbad96b req-09c0ee6a-c9d7-4728-917c-d9407ad21944 tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:02:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-4169d490-043a-4d0c-af28-c5652fbad96b req-09c0ee6a-c9d7-4728-917c-d9407ad21944 tempest-TestInstancesWithCinderVolumes-1667789699 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d', 'name': 'volume-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c6b761a-a8ba-459e-8039-5fde7e0c3f08', 'enforce_multipath': True} {{(pid=86366) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 12:02:21 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-4169d490-043a-4d0c-af28-c5652fbad96b req-09c0ee6a-c9d7-4728-917c-d9407ad21944 tempest-TestInstancesWithCinderVolumes-1667789699 None] attachment_update completed successfully. Sep 21 12:02:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-d320bdfe-6927-4c84-8c02-b1deeb764217 req-ddfaaef2-1c95-4053-921e-cedab8090bf0 tempest-TestMinimumBasicScenario-1727933180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:02:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-d320bdfe-6927-4c84-8c02-b1deeb764217 req-ddfaaef2-1c95-4053-921e-cedab8090bf0 tempest-TestMinimumBasicScenario-1727933180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:02:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-d320bdfe-6927-4c84-8c02-b1deeb764217 req-ddfaaef2-1c95-4053-921e-cedab8090bf0 tempest-TestMinimumBasicScenario-1727933180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:02:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-d320bdfe-6927-4c84-8c02-b1deeb764217 req-ddfaaef2-1c95-4053-921e-cedab8090bf0 tempest-TestMinimumBasicScenario-1727933180 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d', 'name': 'volume-cc58c30e-67c4-4aff-a3a0-729aeb4c9dab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da2f7410-7eb8-451b-aa90-ac709219239f', 'enforce_multipath': True} {{(pid=86366) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 12:02:24 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-d320bdfe-6927-4c84-8c02-b1deeb764217 req-ddfaaef2-1c95-4053-921e-cedab8090bf0 tempest-TestMinimumBasicScenario-1727933180 None] attachment_update completed successfully. Sep 21 12:02:26 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:02:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Flow 'volume_create_manager' (df7d536b-f5ae-4c7f-b2b7-4d078e91e7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:02:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c9db4b-01dc-4a0b-9c34-49cdbd29425e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:02:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c9db4b-01dc-4a0b-9c34-49cdbd29425e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-925988719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4179827-f836-4722-aa7c-db2e19368b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adad34ed483c4b7abb20c42820e30622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:02:26Z,use_quota=True,user_id='f818321d482746c98b65bd920775c147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:02:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2847cdca-8d63-4391-bc63-285b53d954a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:02:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2847cdca-8d63-4391-bc63-285b53d954a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:02:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4589ebba-1aa3-40c7-907c-9c10a924e338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:02:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4589ebba-1aa3-40c7-907c-9c10a924e338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4179827-f836-4722-aa7c-db2e19368b9d', 'volume_name': 'volume-a4179827-f836-4722-aa7c-db2e19368b9d', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:02:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89778c8e-82a3-4d17-baf1-57d6582a6b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:02:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89778c8e-82a3-4d17-baf1-57d6582a6b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:02:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27ce9a2e-cbe3-4261-8a65-e9faf5d7362a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:02:26 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Volume a4179827-f836-4722-aa7c-db2e19368b9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4179827-f836-4722-aa7c-db2e19368b9d', 'volume_size': 1} Sep 21 12:02:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:02:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:02:26 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-925988719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4179827-f836-4722-aa7c-db2e19368b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adad34ed483c4b7abb20c42820e30622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:02:26Z,use_quota=True,user_id='f818321d482746c98b65bd920775c147',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:02:26 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Creating volume a4179827-f836-4722-aa7c-db2e19368b9d {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:02:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:02:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:02:26 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:02:26 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:02:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:02:26 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:02:26 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:02:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:26 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d 1073741824 Sep 21 12:02:26 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:27 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d 1073741824" returned: 0 in 1.279s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:27 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d Sep 21 12:02:27 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:28 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d" returned: 0 in 0.518s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:28 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] <== create_volume: return (1920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:02:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.930s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:02:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27ce9a2e-cbe3-4261-8a65-e9faf5d7362a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4179827-f836-4722-aa7c-db2e19368b9d', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:02:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a5cbbc-57fc-493f-878d-8f9632b226f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:02:28 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Volume volume-a4179827-f836-4722-aa7c-db2e19368b9d (a4179827-f836-4722-aa7c-db2e19368b9d): created successfully Sep 21 12:02:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a5cbbc-57fc-493f-878d-8f9632b226f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:02:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Flow 'volume_create_manager' (df7d536b-f5ae-4c7f-b2b7-4d078e91e7a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:02:28 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-4e5531d9-7658-4a07-9f3b-48107c7bd881 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Created volume successfully. Sep 21 12:02:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-dfea5d93-d1bd-422b-91dd-bc9f1029804a tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:02:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-dfea5d93-d1bd-422b-91dd-bc9f1029804a tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:02:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-dfea5d93-d1bd-422b-91dd-bc9f1029804a tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Creating offline snapshot 44c86b1e-8874-40b7-a347-1f19cc6d74dc of volume a4179827-f836-4722-aa7c-db2e19368b9d {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:02:29 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[94795365-ec64-4803-ae73-5656bee9dfc1]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:02:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dfea5d93-d1bd-422b-91dd-bc9f1029804a tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:30 devstack sudo[98803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d Sep 21 12:02:30 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:30 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dfea5d93-d1bd-422b-91dd-bc9f1029804a tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d" returned: 0 in 0.917s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dfea5d93-d1bd-422b-91dd-bc9f1029804a tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d.44c86b1e-8874-40b7-a347-1f19cc6d74dc 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:30 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d.44c86b1e-8874-40b7-a347-1f19cc6d74dc 1G Sep 21 12:02:30 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:31 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dfea5d93-d1bd-422b-91dd-bc9f1029804a tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d.44c86b1e-8874-40b7-a347-1f19cc6d74dc 1G" returned: 0 in 0.824s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dfea5d93-d1bd-422b-91dd-bc9f1029804a tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4179827-f836-4722-aa7c-db2e19368b9d -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d.44c86b1e-8874-40b7-a347-1f19cc6d74dc {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:31 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4179827-f836-4722-aa7c-db2e19368b9d -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d.44c86b1e-8874-40b7-a347-1f19cc6d74dc Sep 21 12:02:31 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:32 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dfea5d93-d1bd-422b-91dd-bc9f1029804a tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4179827-f836-4722-aa7c-db2e19368b9d -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d.44c86b1e-8874-40b7-a347-1f19cc6d74dc" returned: 0 in 0.468s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:32 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-dfea5d93-d1bd-422b-91dd-bc9f1029804a tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d.44c86b1e-8874-40b7-a347-1f19cc6d74dc is being set with open permissions: ugo+rw Sep 21 12:02:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dfea5d93-d1bd-422b-91dd-bc9f1029804a tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d.44c86b1e-8874-40b7-a347-1f19cc6d74dc {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:32 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d.44c86b1e-8874-40b7-a347-1f19cc6d74dc Sep 21 12:02:32 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:32 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dfea5d93-d1bd-422b-91dd-bc9f1029804a tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d.44c86b1e-8874-40b7-a347-1f19cc6d74dc" returned: 0 in 0.449s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dfea5d93-d1bd-422b-91dd-bc9f1029804a tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:32 devstack sudo[98836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d.info Sep 21 12:02:32 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:33 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dfea5d93-d1bd-422b-91dd-bc9f1029804a tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d.info" returned: 0 in 0.467s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:33 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-dfea5d93-d1bd-422b-91dd-bc9f1029804a tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d.info is being set with open permissions: ugo+rw Sep 21 12:02:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dfea5d93-d1bd-422b-91dd-bc9f1029804a tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:33 devstack sudo[98840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d.info Sep 21 12:02:33 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:33 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-dfea5d93-d1bd-422b-91dd-bc9f1029804a tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d.info" returned: 0 in 0.494s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-dfea5d93-d1bd-422b-91dd-bc9f1029804a tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.845s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:02:33 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-dfea5d93-d1bd-422b-91dd-bc9f1029804a tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Create snapshot completed successfully Sep 21 12:02:35 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-46d71b65-e33d-4135-a88a-2c34641ce823 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Acquiring lock "cinder-44c86b1e-8874-40b7-a347-1f19cc6d74dc-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:02:35 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-46d71b65-e33d-4135-a88a-2c34641ce823 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Lock "cinder-44c86b1e-8874-40b7-a347-1f19cc6d74dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:02:35 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-46d71b65-e33d-4135-a88a-2c34641ce823 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Acquiring lock "cinder-quobyte-a4179827-f836-4722-aa7c-db2e19368b9d" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:02:35 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-46d71b65-e33d-4135-a88a-2c34641ce823 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Lock "cinder-quobyte-a4179827-f836-4722-aa7c-db2e19368b9d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:02:35 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-46d71b65-e33d-4135-a88a-2c34641ce823 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Acquiring lock "cinder-quobyte-44c86b1e-8874-40b7-a347-1f19cc6d74dc" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:02:35 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-46d71b65-e33d-4135-a88a-2c34641ce823 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Lock "cinder-quobyte-44c86b1e-8874-40b7-a347-1f19cc6d74dc" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:02:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-46d71b65-e33d-4135-a88a-2c34641ce823 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Deleting offline snapshot 44c86b1e-8874-40b7-a347-1f19cc6d74dc of volume a4179827-f836-4722-aa7c-db2e19368b9d {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:02:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-46d71b65-e33d-4135-a88a-2c34641ce823 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] snapshot_file for this snap is: volume-a4179827-f836-4722-aa7c-db2e19368b9d.44c86b1e-8874-40b7-a347-1f19cc6d74dc {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:02:35 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[16215f9f-27c3-4a67-a9e3-ff148185238d]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:02:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-46d71b65-e33d-4135-a88a-2c34641ce823 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d.44c86b1e-8874-40b7-a347-1f19cc6d74dc {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:35 devstack sudo[98843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d.44c86b1e-8874-40b7-a347-1f19cc6d74dc Sep 21 12:02:35 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:36 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-46d71b65-e33d-4135-a88a-2c34641ce823 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d.44c86b1e-8874-40b7-a347-1f19cc6d74dc" returned: 0 in 0.759s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:36 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-46d71b65-e33d-4135-a88a-2c34641ce823 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4179827-f836-4722-aa7c-db2e19368b9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:02:36 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[61942343-6c24-4fb0-b6c0-b5b27426b621]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:02:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-46d71b65-e33d-4135-a88a-2c34641ce823 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:36 devstack sudo[98848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d Sep 21 12:02:36 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:37 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-46d71b65-e33d-4135-a88a-2c34641ce823 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d" returned: 0 in 0.933s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-46d71b65-e33d-4135-a88a-2c34641ce823 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d.44c86b1e-8874-40b7-a347-1f19cc6d74dc {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:37 devstack sudo[98855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d.44c86b1e-8874-40b7-a347-1f19cc6d74dc Sep 21 12:02:37 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:37 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-46d71b65-e33d-4135-a88a-2c34641ce823 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d.44c86b1e-8874-40b7-a347-1f19cc6d74dc" returned: 0 in 0.752s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-46d71b65-e33d-4135-a88a-2c34641ce823 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d.44c86b1e-8874-40b7-a347-1f19cc6d74dc {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:37 devstack sudo[98861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d.44c86b1e-8874-40b7-a347-1f19cc6d74dc Sep 21 12:02:37 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:38 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-46d71b65-e33d-4135-a88a-2c34641ce823 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d.44c86b1e-8874-40b7-a347-1f19cc6d74dc" returned: 0 in 0.518s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:38 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:UPDATE=71,cinder:SELECT=77,cinder:INSERT=21,cinder:DELETE=5 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:02:38 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=72,cinder:UPDATE=74,cinder:INSERT=17,cinder:DELETE=6 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:02:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-46d71b65-e33d-4135-a88a-2c34641ce823 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Lock "cinder-quobyte-44c86b1e-8874-40b7-a347-1f19cc6d74dc" released by "_delete_snapshot" :: held 3.242s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:02:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-46d71b65-e33d-4135-a88a-2c34641ce823 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Lock "cinder-quobyte-a4179827-f836-4722-aa7c-db2e19368b9d" released by "delete_snapshot" :: held 3.285s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:02:38 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-46d71b65-e33d-4135-a88a-2c34641ce823 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Created reservations ['35bc720e-923c-4741-ac55-1df10b3ebd6d', 'aca648e7-7dcd-479e-aadb-9f0b3b47fcd4', '55cbc102-01d9-44ca-a836-666e339866b3', 'b0e6744f-bf77-4c4d-860c-1d174f37ee07'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:02:38 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-46d71b65-e33d-4135-a88a-2c34641ce823 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Delete snapshot completed successfully. Sep 21 12:02:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-46d71b65-e33d-4135-a88a-2c34641ce823 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Lock "cinder-44c86b1e-8874-40b7-a347-1f19cc6d74dc-delete_snapshot" released by "delete_snapshot" :: held 3.543s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:02:39 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-54b16744-e3d4-408a-8137-f24527639354 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Acquiring lock "cinder-a4179827-f836-4722-aa7c-db2e19368b9d-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:02:39 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-54b16744-e3d4-408a-8137-f24527639354 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Lock "cinder-a4179827-f836-4722-aa7c-db2e19368b9d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:02:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-54b16744-e3d4-408a-8137-f24527639354 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Acquiring lock "cinder-quobyte-a4179827-f836-4722-aa7c-db2e19368b9d" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:02:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-54b16744-e3d4-408a-8137-f24527639354 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Lock "cinder-quobyte-a4179827-f836-4722-aa7c-db2e19368b9d" acquired by "delete_volume" :: waited 0.068s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:02:40 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbfafb4-c984-4c0b-bd67-c55a8ae87b18]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:02:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-54b16744-e3d4-408a-8137-f24527639354 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:40 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d Sep 21 12:02:40 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:41 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-54b16744-e3d4-408a-8137-f24527639354 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d" returned: 0 in 0.742s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-54b16744-e3d4-408a-8137-f24527639354 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:41 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d Sep 21 12:02:41 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:41 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-54b16744-e3d4-408a-8137-f24527639354 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a4179827-f836-4722-aa7c-db2e19368b9d" returned: 0 in 0.609s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:41 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-54b16744-e3d4-408a-8137-f24527639354 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Lock "cinder-quobyte-a4179827-f836-4722-aa7c-db2e19368b9d" released by "delete_volume" :: held 1.490s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:02:41 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-54b16744-e3d4-408a-8137-f24527639354 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Created reservations ['d42aee91-00b3-4e98-ae76-ee69ac99318f', 'a714ff40-17b1-4ea8-ab1f-7994053c8463', '5a5d657d-47c0-481d-9393-6015b6890c72', 'c53da253-e4b0-4f73-96f8-19f8322c2182'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:02:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-54b16744-e3d4-408a-8137-f24527639354 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:02:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-54b16744-e3d4-408a-8137-f24527639354 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:02:42 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-54b16744-e3d4-408a-8137-f24527639354 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:02:42 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-54b16744-e3d4-408a-8137-f24527639354 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:02:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-54b16744-e3d4-408a-8137-f24527639354 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:02:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-54b16744-e3d4-408a-8137-f24527639354 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:02:42 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:02:42 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:02:42 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Sep 21 12:02:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-54b16744-e3d4-408a-8137-f24527639354 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.671s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:02:42 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-54b16744-e3d4-408a-8137-f24527639354 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:02:42 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-54b16744-e3d4-408a-8137-f24527639354 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Deleted volume successfully. Sep 21 12:02:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-54b16744-e3d4-408a-8137-f24527639354 tempest-VolumeSnapshotQuotasNegativeTestJSON-3973916 None] Lock "cinder-a4179827-f836-4722-aa7c-db2e19368b9d-delete_volume" released by "delete_volume" :: held 2.801s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:02:51 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=10,cinder:INSERT=4,cinder:UPDATE=10 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:02:52 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=9,cinder:INSERT=4,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:03:00 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:03:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Flow 'volume_create_manager' (bbddfe72-8f84-44b7-a89a-859425dda60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:03:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf67b637-ec03-4112-b720-1c798f1addce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf67b637-ec03-4112-b720-1c798f1addce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-219362687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc8cd6fb-7fbc-4432-9541-6db0891a3e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc47150994dc4cf99b38988c5ecd270e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:03:00Z,use_quota=True,user_id='3cdc618fb0754a6e9cd9dd27fda51f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3380e6fd-028d-42b6-8498-a0379ccaf8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3380e6fd-028d-42b6-8498-a0379ccaf8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c205fa29-3008-4c7d-ac12-077d26f59ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c205fa29-3008-4c7d-ac12-077d26f59ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc8cd6fb-7fbc-4432-9541-6db0891a3e59', 'volume_name': 'volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a48f8a-f7c9-4344-beb0-b088509b3921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a48f8a-f7c9-4344-beb0-b088509b3921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79210fe1-27ad-47f3-8215-39f56f51c039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:00 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Volume dc8cd6fb-7fbc-4432-9541-6db0891a3e59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59', 'volume_size': 1} Sep 21 12:03:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-219362687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc8cd6fb-7fbc-4432-9541-6db0891a3e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc47150994dc4cf99b38988c5ecd270e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:03:00Z,use_quota=True,user_id='3cdc618fb0754a6e9cd9dd27fda51f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:03:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Creating volume dc8cd6fb-7fbc-4432-9541-6db0891a3e59 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:03:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:03:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:03:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:03:00 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:03:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:00 devstack sudo[99007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59 1073741824 Sep 21 12:03:00 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:01 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59 1073741824" returned: 0 in 0.665s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:01 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59 Sep 21 12:03:01 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-da1acf76-6745-4ece-b49c-c3174cde4887 req-1f3cb5e1-10fc-42f7-bc22-8fdc0d4797a8 tempest-TestInstancesWithCinderVolumes-1667789699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:01 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59" returned: 0 in 0.269s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:03:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-da1acf76-6745-4ece-b49c-c3174cde4887 req-1f3cb5e1-10fc-42f7-bc22-8fdc0d4797a8 tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.200s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-da1acf76-6745-4ece-b49c-c3174cde4887 req-1f3cb5e1-10fc-42f7-bc22-8fdc0d4797a8 tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79210fe1-27ad-47f3-8215-39f56f51c039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95477d62-0355-49e5-8c60-b993052ed030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:01 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Volume volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59 (dc8cd6fb-7fbc-4432-9541-6db0891a3e59): created successfully Sep 21 12:03:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95477d62-0355-49e5-8c60-b993052ed030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Flow 'volume_create_manager' (bbddfe72-8f84-44b7-a89a-859425dda60f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:03:01 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-c04858ac-8d2b-43fe-b1bc-526b0796f03e tempest-VolumesDeleteCascade-1232314083 None] Created volume successfully. Sep 21 12:03:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-da1acf76-6745-4ece-b49c-c3174cde4887 req-1f3cb5e1-10fc-42f7-bc22-8fdc0d4797a8 tempest-TestInstancesWithCinderVolumes-1667789699 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d', 'name': 'volume-2844fbed-b749-46f2-8d74-9c7a02d510e7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60a906e8-3e62-4081-9e58-3b7c1d48d2a7', 'enforce_multipath': True} {{(pid=86366) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 12:03:01 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-da1acf76-6745-4ece-b49c-c3174cde4887 req-1f3cb5e1-10fc-42f7-bc22-8fdc0d4797a8 tempest-TestInstancesWithCinderVolumes-1667789699 None] attachment_update completed successfully. Sep 21 12:03:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-be7d0323-6146-482a-b29e-da344e433429 tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-be7d0323-6146-482a-b29e-da344e433429 tempest-VolumesDeleteCascade-1232314083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-be7d0323-6146-482a-b29e-da344e433429 tempest-VolumesDeleteCascade-1232314083 None] Creating offline snapshot 20e51318-e48e-46a0-9cd7-52cdc3f41886 of volume dc8cd6fb-7fbc-4432-9541-6db0891a3e59 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:03:02 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d108960-98b1-40c5-9bb1-c52be970bd9c]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:03:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-be7d0323-6146-482a-b29e-da344e433429 tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:02 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59 Sep 21 12:03:02 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:03 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-be7d0323-6146-482a-b29e-da344e433429 tempest-VolumesDeleteCascade-1232314083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59" returned: 0 in 0.538s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-be7d0323-6146-482a-b29e-da344e433429 tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:03 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886 1G Sep 21 12:03:03 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:03 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 12:03:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:03:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:03:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:03 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:03:03 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:03 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-be7d0323-6146-482a-b29e-da344e433429 tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886 1G" returned: 0 in 0.603s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-be7d0323-6146-482a-b29e-da344e433429 tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:04 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886 Sep 21 12:03:04 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:04 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.368s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:04 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:03:04 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 12:03:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread count: 28 {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 12:03:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread info: [<_MainThread(MainThread, started 132841976594560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 12:03:04 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-be7d0323-6146-482a-b29e-da344e433429 tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886" returned: 0 in 0.390s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:04 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-be7d0323-6146-482a-b29e-da344e433429 tempest-VolumesDeleteCascade-1232314083 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886 is being set with open permissions: ugo+rw Sep 21 12:03:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-be7d0323-6146-482a-b29e-da344e433429 tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:04 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886 Sep 21 12:03:04 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:04 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-be7d0323-6146-482a-b29e-da344e433429 tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886" returned: 0 in 0.316s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-be7d0323-6146-482a-b29e-da344e433429 tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:04 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.info Sep 21 12:03:04 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-58c60eb0-d810-4b48-8e3d-8efb08412786 req-c33eb997-92db-4fb8-815e-0f525c234dd9 tempest-TestInstancesWithCinderVolumes-1667789699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:05 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-be7d0323-6146-482a-b29e-da344e433429 tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.info" returned: 0 in 0.329s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:05 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-be7d0323-6146-482a-b29e-da344e433429 tempest-VolumesDeleteCascade-1232314083 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.info is being set with open permissions: ugo+rw Sep 21 12:03:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-be7d0323-6146-482a-b29e-da344e433429 tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:05 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.info Sep 21 12:03:05 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:05 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-be7d0323-6146-482a-b29e-da344e433429 tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.info" returned: 0 in 0.306s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-be7d0323-6146-482a-b29e-da344e433429 tempest-VolumesDeleteCascade-1232314083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.593s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-58c60eb0-d810-4b48-8e3d-8efb08412786 req-c33eb997-92db-4fb8-815e-0f525c234dd9 tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.518s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-58c60eb0-d810-4b48-8e3d-8efb08412786 req-c33eb997-92db-4fb8-815e-0f525c234dd9 tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:05 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-be7d0323-6146-482a-b29e-da344e433429 tempest-VolumesDeleteCascade-1232314083 None] Create snapshot completed successfully Sep 21 12:03:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-58c60eb0-d810-4b48-8e3d-8efb08412786 req-c33eb997-92db-4fb8-815e-0f525c234dd9 tempest-TestInstancesWithCinderVolumes-1667789699 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d', 'name': 'volume-3cea9e23-0d1a-460f-9034-335eb9cf0a31', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f594ff0f-ef26-48a4-9cb5-e10afbedae96', 'enforce_multipath': True} {{(pid=86366) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 12:03:05 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-58c60eb0-d810-4b48-8e3d-8efb08412786 req-c33eb997-92db-4fb8-815e-0f525c234dd9 tempest-TestInstancesWithCinderVolumes-1667789699 None] attachment_update completed successfully. Sep 21 12:03:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4d967870-478b-4b82-8720-ccbcf664724e tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4d967870-478b-4b82-8720-ccbcf664724e tempest-VolumesDeleteCascade-1232314083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:06 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-4d967870-478b-4b82-8720-ccbcf664724e tempest-VolumesDeleteCascade-1232314083 None] Creating offline snapshot 8ebd3d3e-e1dc-4938-a143-42ed48a6fe64 of volume dc8cd6fb-7fbc-4432-9541-6db0891a3e59 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:03:06 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecf0e08-e86b-4165-93ed-058a5b3d3a1b]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:03:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4d967870-478b-4b82-8720-ccbcf664724e tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:06 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886 Sep 21 12:03:06 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:06 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4d967870-478b-4b82-8720-ccbcf664724e tempest-VolumesDeleteCascade-1232314083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886" returned: 0 in 0.459s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:06 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-4d967870-478b-4b82-8720-ccbcf664724e tempest-VolumesDeleteCascade-1232314083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:03:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4d967870-478b-4b82-8720-ccbcf664724e tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.8ebd3d3e-e1dc-4938-a143-42ed48a6fe64 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:06 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.8ebd3d3e-e1dc-4938-a143-42ed48a6fe64 1G Sep 21 12:03:06 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:07 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4d967870-478b-4b82-8720-ccbcf664724e tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.8ebd3d3e-e1dc-4938-a143-42ed48a6fe64 1G" returned: 0 in 0.735s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4d967870-478b-4b82-8720-ccbcf664724e tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.8ebd3d3e-e1dc-4938-a143-42ed48a6fe64 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:07 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.8ebd3d3e-e1dc-4938-a143-42ed48a6fe64 Sep 21 12:03:07 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:08 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4d967870-478b-4b82-8720-ccbcf664724e tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.8ebd3d3e-e1dc-4938-a143-42ed48a6fe64" returned: 0 in 0.453s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:08 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-4d967870-478b-4b82-8720-ccbcf664724e tempest-VolumesDeleteCascade-1232314083 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.8ebd3d3e-e1dc-4938-a143-42ed48a6fe64 is being set with open permissions: ugo+rw Sep 21 12:03:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4d967870-478b-4b82-8720-ccbcf664724e tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.8ebd3d3e-e1dc-4938-a143-42ed48a6fe64 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:08 devstack sudo[99106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.8ebd3d3e-e1dc-4938-a143-42ed48a6fe64 Sep 21 12:03:08 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:08 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4d967870-478b-4b82-8720-ccbcf664724e tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.8ebd3d3e-e1dc-4938-a143-42ed48a6fe64" returned: 0 in 0.413s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4d967870-478b-4b82-8720-ccbcf664724e tempest-VolumesDeleteCascade-1232314083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.226s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:08 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-4d967870-478b-4b82-8720-ccbcf664724e tempest-VolumesDeleteCascade-1232314083 None] Create snapshot completed successfully Sep 21 12:03:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "cinder-dc8cd6fb-7fbc-4432-9541-6db0891a3e59-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-dc8cd6fb-7fbc-4432-9541-6db0891a3e59-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:09 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Performing cascade delete. {{(pid=86366) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 21 12:03:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "cinder-20e51318-e48e-46a0-9cd7-52cdc3f41886-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-20e51318-e48e-46a0-9cd7-52cdc3f41886-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "cinder-quobyte-dc8cd6fb-7fbc-4432-9541-6db0891a3e59" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-quobyte-dc8cd6fb-7fbc-4432-9541-6db0891a3e59" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "cinder-quobyte-20e51318-e48e-46a0-9cd7-52cdc3f41886" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-quobyte-20e51318-e48e-46a0-9cd7-52cdc3f41886" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Deleting offline snapshot 20e51318-e48e-46a0-9cd7-52cdc3f41886 of volume dc8cd6fb-7fbc-4432-9541-6db0891a3e59 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:03:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] snapshot_file for this snap is: volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:03:09 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[970fa147-2dcf-4027-9048-d4706f466887]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:03:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:10 devstack sudo[99112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886 Sep 21 12:03:10 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:10 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886" returned: 0 in 0.460s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:10 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:03:10 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c81764f-1451-48ec-8f2e-7499769a0afd]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:03:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:10 devstack sudo[99124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59 Sep 21 12:03:10 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:10 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59" returned: 0 in 0.439s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:10 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32b5d74-8137-4bd6-856d-c027c41d8ace]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:03:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.8ebd3d3e-e1dc-4938-a143-42ed48a6fe64 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:11 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.8ebd3d3e-e1dc-4938-a143-42ed48a6fe64 Sep 21 12:03:11 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:11 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.8ebd3d3e-e1dc-4938-a143-42ed48a6fe64" returned: 0 in 0.467s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:11 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:03:11 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59c4b7f-da8c-410b-a9f5-031b75295d4d]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:03:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:11 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886 Sep 21 12:03:11 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:11 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886" returned: 0 in 0.520s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:11 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:03:11 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad20cdd5-d909-4ebb-beea-220a8d958541]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:03:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:12 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59 Sep 21 12:03:12 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:12 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-89969f1e-e16e-4411-ac7b-0828ee127e2c req-4388d4db-02d1-4af2-9d18-51ee23258572 tempest-TestInstancesWithCinderVolumes-1667789699 None] Terminate volume connection completed successfully. Sep 21 12:03:12 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-89969f1e-e16e-4411-ac7b-0828ee127e2c req-4388d4db-02d1-4af2-9d18-51ee23258572 tempest-TestInstancesWithCinderVolumes-1667789699 None] Deleting attachment 60a906e8-3e62-4081-9e58-3b7c1d48d2a7. {{(pid=86366) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 12:03:12 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59" returned: 0 in 0.511s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:12 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886 Sep 21 12:03:12 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fe06435e-5566-4729-8782-cc850a4ff7ae tempest-TestInstancesWithCinderVolumes-1667789699 None] Acquiring lock "cinder-2844fbed-b749-46f2-8d74-9c7a02d510e7-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fe06435e-5566-4729-8782-cc850a4ff7ae tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "cinder-2844fbed-b749-46f2-8d74-9c7a02d510e7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fe06435e-5566-4729-8782-cc850a4ff7ae tempest-TestInstancesWithCinderVolumes-1667789699 None] Acquiring lock "cinder-quobyte-2844fbed-b749-46f2-8d74-9c7a02d510e7" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fe06435e-5566-4729-8782-cc850a4ff7ae tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "cinder-quobyte-2844fbed-b749-46f2-8d74-9c7a02d510e7" acquired by "delete_volume" :: waited 0.033s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:13 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886" returned: 0 in 0.519s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:13 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[9974082d-e83c-4c5f-9c4f-37aaccad4633]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:03:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fe06435e-5566-4729-8782-cc850a4ff7ae tempest-TestInstancesWithCinderVolumes-1667789699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2844fbed-b749-46f2-8d74-9c7a02d510e7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:13 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886 Sep 21 12:03:13 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:13 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2844fbed-b749-46f2-8d74-9c7a02d510e7 Sep 21 12:03:13 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:13 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.20e51318-e48e-46a0-9cd7-52cdc3f41886" returned: 0 in 0.357s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.8ebd3d3e-e1dc-4938-a143-42ed48a6fe64 -F qcow2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:13 devstack sudo[99182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.8ebd3d3e-e1dc-4938-a143-42ed48a6fe64 -F qcow2 Sep 21 12:03:13 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:13 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fe06435e-5566-4729-8782-cc850a4ff7ae tempest-TestInstancesWithCinderVolumes-1667789699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2844fbed-b749-46f2-8d74-9c7a02d510e7" returned: 0 in 0.655s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fe06435e-5566-4729-8782-cc850a4ff7ae tempest-TestInstancesWithCinderVolumes-1667789699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2844fbed-b749-46f2-8d74-9c7a02d510e7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:13 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2844fbed-b749-46f2-8d74-9c7a02d510e7 Sep 21 12:03:13 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:13 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.8ebd3d3e-e1dc-4938-a143-42ed48a6fe64 -F qcow2" returned: 0 in 0.522s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:13 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-quobyte-20e51318-e48e-46a0-9cd7-52cdc3f41886" released by "_delete_snapshot" :: held 4.163s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:13 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-quobyte-dc8cd6fb-7fbc-4432-9541-6db0891a3e59" released by "delete_snapshot" :: held 4.207s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:14 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Created reservations ['d9f3bc05-eb4f-4ed6-83f7-546773d1c6f6', 'd67ec574-faaa-4821-bb2e-e918ead928da', '490072d3-63b9-4fbb-ae06-f69174aafb98', 'd317dd13-58ea-4de9-a506-d4fac3c59b69'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:03:14 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fe06435e-5566-4729-8782-cc850a4ff7ae tempest-TestInstancesWithCinderVolumes-1667789699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2844fbed-b749-46f2-8d74-9c7a02d510e7" returned: 0 in 0.515s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fe06435e-5566-4729-8782-cc850a4ff7ae tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "cinder-quobyte-2844fbed-b749-46f2-8d74-9c7a02d510e7" released by "delete_volume" :: held 1.271s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:14 devstack cinder-volume[86366]: WARNING cinder.quota [None req-fe06435e-5566-4729-8782-cc850a4ff7ae tempest-TestInstancesWithCinderVolumes-1667789699 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-83337911-128778797 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-83337911-128778797, it is now deprecated. Please use the default quota class for default quota. Sep 21 12:03:14 devstack cinder-volume[86366]: WARNING cinder.quota [None req-fe06435e-5566-4729-8782-cc850a4ff7ae tempest-TestInstancesWithCinderVolumes-1667789699 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-83337911-128778797 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-83337911-128778797, it is now deprecated. Please use the default quota class for default quota. Sep 21 12:03:14 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Delete snapshot completed successfully. Sep 21 12:03:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-20e51318-e48e-46a0-9cd7-52cdc3f41886-delete_snapshot" released by "delete_snapshot" :: held 4.646s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "cinder-8ebd3d3e-e1dc-4938-a143-42ed48a6fe64-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:14 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-fe06435e-5566-4729-8782-cc850a4ff7ae tempest-TestInstancesWithCinderVolumes-1667789699 None] Created reservations ['f9e6a322-8a28-4f54-bc1f-ad10b8dfc9f0', '5713aaf6-b868-4c2a-91ab-65f80c9331f1', '607b56d1-52c2-4425-bf8d-0eb205a3ec73', '6da1262e-ce16-485b-8f12-de1815e1b76c'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:03:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-8ebd3d3e-e1dc-4938-a143-42ed48a6fe64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "cinder-quobyte-dc8cd6fb-7fbc-4432-9541-6db0891a3e59" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-quobyte-dc8cd6fb-7fbc-4432-9541-6db0891a3e59" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "cinder-quobyte-8ebd3d3e-e1dc-4938-a143-42ed48a6fe64" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-quobyte-8ebd3d3e-e1dc-4938-a143-42ed48a6fe64" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:14 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Deleting offline snapshot 8ebd3d3e-e1dc-4938-a143-42ed48a6fe64 of volume dc8cd6fb-7fbc-4432-9541-6db0891a3e59 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:03:14 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] snapshot_file for this snap is: volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.8ebd3d3e-e1dc-4938-a143-42ed48a6fe64 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:03:14 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[6274ab92-f7e8-456c-8de6-5c0f1db829db]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:03:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.8ebd3d3e-e1dc-4938-a143-42ed48a6fe64 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fe06435e-5566-4729-8782-cc850a4ff7ae tempest-TestInstancesWithCinderVolumes-1667789699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fe06435e-5566-4729-8782-cc850a4ff7ae tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:14 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fe06435e-5566-4729-8782-cc850a4ff7ae tempest-TestInstancesWithCinderVolumes-1667789699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:03:14 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fe06435e-5566-4729-8782-cc850a4ff7ae tempest-TestInstancesWithCinderVolumes-1667789699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:03:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fe06435e-5566-4729-8782-cc850a4ff7ae tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fe06435e-5566-4729-8782-cc850a4ff7ae tempest-TestInstancesWithCinderVolumes-1667789699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:14 devstack sudo[99197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:03:14 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:14 devstack sudo[99196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.8ebd3d3e-e1dc-4938-a143-42ed48a6fe64 Sep 21 12:03:14 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:15 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fe06435e-5566-4729-8782-cc850a4ff7ae tempest-TestInstancesWithCinderVolumes-1667789699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.607s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:15 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-fe06435e-5566-4729-8782-cc850a4ff7ae tempest-TestInstancesWithCinderVolumes-1667789699 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:03:15 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-fe06435e-5566-4729-8782-cc850a4ff7ae tempest-TestInstancesWithCinderVolumes-1667789699 None] Deleted volume successfully. Sep 21 12:03:15 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-d32c1a7a-aad8-4f6e-9da7-d9dcedb948ce req-1404e8c4-5d0d-42ae-acf9-89652eac644b tempest-TestMinimumBasicScenario-1727933180 None] Terminate volume connection completed successfully. Sep 21 12:03:15 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-d32c1a7a-aad8-4f6e-9da7-d9dcedb948ce req-1404e8c4-5d0d-42ae-acf9-89652eac644b tempest-TestMinimumBasicScenario-1727933180 None] Deleting attachment da2f7410-7eb8-451b-aa90-ac709219239f. {{(pid=86366) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 12:03:15 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fe06435e-5566-4729-8782-cc850a4ff7ae tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "cinder-2844fbed-b749-46f2-8d74-9c7a02d510e7-delete_volume" released by "delete_volume" :: held 2.551s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:15 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.8ebd3d3e-e1dc-4938-a143-42ed48a6fe64" returned: 0 in 0.797s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:15 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:03:15 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab15ef62-5bbc-49f3-a160-1d96815a0f12]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:03:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:15 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59 Sep 21 12:03:15 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:16 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-19c60a2c-80b2-4f64-94a9-a9fd4aed6da3 tempest-TestMinimumBasicScenario-1727933180 None] Acquiring lock "cinder-cc58c30e-67c4-4aff-a3a0-729aeb4c9dab-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:16 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59" returned: 0 in 0.523s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.8ebd3d3e-e1dc-4938-a143-42ed48a6fe64 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:16 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-19c60a2c-80b2-4f64-94a9-a9fd4aed6da3 tempest-TestMinimumBasicScenario-1727933180 None] Lock "cinder-cc58c30e-67c4-4aff-a3a0-729aeb4c9dab-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:16 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.8ebd3d3e-e1dc-4938-a143-42ed48a6fe64 Sep 21 12:03:16 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:16 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-19c60a2c-80b2-4f64-94a9-a9fd4aed6da3 tempest-TestMinimumBasicScenario-1727933180 None] Acquiring lock "cinder-quobyte-cc58c30e-67c4-4aff-a3a0-729aeb4c9dab" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:16 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-19c60a2c-80b2-4f64-94a9-a9fd4aed6da3 tempest-TestMinimumBasicScenario-1727933180 None] Lock "cinder-quobyte-cc58c30e-67c4-4aff-a3a0-729aeb4c9dab" acquired by "delete_volume" :: waited 0.025s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:16 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d44d10-adc0-4393-8e8f-2567670de035]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:03:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-19c60a2c-80b2-4f64-94a9-a9fd4aed6da3 tempest-TestMinimumBasicScenario-1727933180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-cc58c30e-67c4-4aff-a3a0-729aeb4c9dab {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:16 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-cc58c30e-67c4-4aff-a3a0-729aeb4c9dab Sep 21 12:03:16 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:16 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.8ebd3d3e-e1dc-4938-a143-42ed48a6fe64" returned: 0 in 0.474s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.8ebd3d3e-e1dc-4938-a143-42ed48a6fe64 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:16 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.8ebd3d3e-e1dc-4938-a143-42ed48a6fe64 Sep 21 12:03:16 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:16 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-19c60a2c-80b2-4f64-94a9-a9fd4aed6da3 tempest-TestMinimumBasicScenario-1727933180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-cc58c30e-67c4-4aff-a3a0-729aeb4c9dab" returned: 0 in 0.524s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-19c60a2c-80b2-4f64-94a9-a9fd4aed6da3 tempest-TestMinimumBasicScenario-1727933180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-cc58c30e-67c4-4aff-a3a0-729aeb4c9dab {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:16 devstack sudo[99235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-cc58c30e-67c4-4aff-a3a0-729aeb4c9dab Sep 21 12:03:16 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:16 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59.8ebd3d3e-e1dc-4938-a143-42ed48a6fe64" returned: 0 in 0.322s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:16 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-quobyte-8ebd3d3e-e1dc-4938-a143-42ed48a6fe64" released by "_delete_snapshot" :: held 2.314s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:16 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-quobyte-dc8cd6fb-7fbc-4432-9541-6db0891a3e59" released by "delete_snapshot" :: held 2.390s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:17 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Created reservations ['169a45e6-670f-49ed-9025-cf8c886df8db', '4a17b707-bfde-49b2-9151-5c991d5afab7', 'a285bb4f-4660-4372-a774-d8d24bf9b287', '511dd233-a898-4ccd-85c0-2d77eabc3b81'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:03:17 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Delete snapshot completed successfully. Sep 21 12:03:17 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-19c60a2c-80b2-4f64-94a9-a9fd4aed6da3 tempest-TestMinimumBasicScenario-1727933180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-cc58c30e-67c4-4aff-a3a0-729aeb4c9dab" returned: 0 in 0.374s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-8ebd3d3e-e1dc-4938-a143-42ed48a6fe64-delete_snapshot" released by "delete_snapshot" :: held 2.655s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Snapshots deleted, issuing volume delete {{(pid=86366) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 21 12:03:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "cinder-quobyte-dc8cd6fb-7fbc-4432-9541-6db0891a3e59" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-19c60a2c-80b2-4f64-94a9-a9fd4aed6da3 tempest-TestMinimumBasicScenario-1727933180 None] Lock "cinder-quobyte-cc58c30e-67c4-4aff-a3a0-729aeb4c9dab" released by "delete_volume" :: held 0.957s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-quobyte-dc8cd6fb-7fbc-4432-9541-6db0891a3e59" acquired by "delete_volume" :: waited 0.025s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:17 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[81010729-b8a0-4ded-a858-50b84f5de65d]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:03:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:17 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-19c60a2c-80b2-4f64-94a9-a9fd4aed6da3 tempest-TestMinimumBasicScenario-1727933180 None] Created reservations ['1961ad1e-4a68-435e-b498-c1c9434e927f', '108850ed-7564-4085-9bff-ae78ac8554dd', 'af71dc13-4d87-4898-ad9e-2361d663b3be', 'a8828315-5e14-43d9-8d09-1b2106a1c6a0'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:03:17 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59 Sep 21 12:03:17 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-19c60a2c-80b2-4f64-94a9-a9fd4aed6da3 tempest-TestMinimumBasicScenario-1727933180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-19c60a2c-80b2-4f64-94a9-a9fd4aed6da3 tempest-TestMinimumBasicScenario-1727933180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:17 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-19c60a2c-80b2-4f64-94a9-a9fd4aed6da3 tempest-TestMinimumBasicScenario-1727933180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:03:17 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-19c60a2c-80b2-4f64-94a9-a9fd4aed6da3 tempest-TestMinimumBasicScenario-1727933180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:03:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-19c60a2c-80b2-4f64-94a9-a9fd4aed6da3 tempest-TestMinimumBasicScenario-1727933180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-19c60a2c-80b2-4f64-94a9-a9fd4aed6da3 tempest-TestMinimumBasicScenario-1727933180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:17 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:03:17 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:17 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-19c60a2c-80b2-4f64-94a9-a9fd4aed6da3 tempest-TestMinimumBasicScenario-1727933180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.347s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:17 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-19c60a2c-80b2-4f64-94a9-a9fd4aed6da3 tempest-TestMinimumBasicScenario-1727933180 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:03:17 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-19c60a2c-80b2-4f64-94a9-a9fd4aed6da3 tempest-TestMinimumBasicScenario-1727933180 None] Deleted volume successfully. Sep 21 12:03:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-19c60a2c-80b2-4f64-94a9-a9fd4aed6da3 tempest-TestMinimumBasicScenario-1727933180 None] Lock "cinder-cc58c30e-67c4-4aff-a3a0-729aeb4c9dab-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:17 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59" returned: 0 in 0.579s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:17 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59 Sep 21 12:03:17 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:18 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dc8cd6fb-7fbc-4432-9541-6db0891a3e59" returned: 0 in 0.345s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:18 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-quobyte-dc8cd6fb-7fbc-4432-9541-6db0891a3e59" released by "delete_volume" :: held 1.021s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:18 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Created reservations ['1e162f74-1dd7-4daa-9af0-a99e168ee37f', '3e975522-2cbc-4ccd-bf40-bb0358d569d8', '297b387e-8967-4742-9aa1-4484680e34af', '4b89fbe1-801f-495a-b48d-1ef9250dec3d'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:03:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:18 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:03:18 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:03:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:18 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-720e9868-015d-4748-9e04-69c66f7421c1 req-ff393e1f-7eee-4bca-ba5a-54f6d937c4ab tempest-TestInstancesWithCinderVolumes-1667789699 None] Terminate volume connection completed successfully. Sep 21 12:03:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-720e9868-015d-4748-9e04-69c66f7421c1 req-ff393e1f-7eee-4bca-ba5a-54f6d937c4ab tempest-TestInstancesWithCinderVolumes-1667789699 None] Deleting attachment f594ff0f-ef26-48a4-9cb5-e10afbedae96. {{(pid=86366) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 12:03:18 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:03:18 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:18 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.432s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:18 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:03:18 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Deleted volume successfully. Sep 21 12:03:18 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1cf0bfb5-ebb5-416d-83bd-5b4bbd3ec7dc tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-dc8cd6fb-7fbc-4432-9541-6db0891a3e59-delete_volume" released by "delete_volume" :: held 9.202s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-15ff557a-4efd-497b-9243-5b2d39647cf0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Acquiring lock "cinder-3cea9e23-0d1a-460f-9034-335eb9cf0a31-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-15ff557a-4efd-497b-9243-5b2d39647cf0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "cinder-3cea9e23-0d1a-460f-9034-335eb9cf0a31-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-15ff557a-4efd-497b-9243-5b2d39647cf0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Acquiring lock "cinder-quobyte-3cea9e23-0d1a-460f-9034-335eb9cf0a31" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-15ff557a-4efd-497b-9243-5b2d39647cf0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "cinder-quobyte-3cea9e23-0d1a-460f-9034-335eb9cf0a31" acquired by "delete_volume" :: waited 0.023s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:19 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[587cdc26-cb2e-41fe-86d7-58ac12f96e26]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:03:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-15ff557a-4efd-497b-9243-5b2d39647cf0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3cea9e23-0d1a-460f-9034-335eb9cf0a31 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:19 devstack sudo[99284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3cea9e23-0d1a-460f-9034-335eb9cf0a31 Sep 21 12:03:19 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:20 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-15ff557a-4efd-497b-9243-5b2d39647cf0 tempest-TestInstancesWithCinderVolumes-1667789699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3cea9e23-0d1a-460f-9034-335eb9cf0a31" returned: 0 in 0.684s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-15ff557a-4efd-497b-9243-5b2d39647cf0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3cea9e23-0d1a-460f-9034-335eb9cf0a31 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:20 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3cea9e23-0d1a-460f-9034-335eb9cf0a31 Sep 21 12:03:20 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Flow 'volume_create_manager' (6437fa66-0beb-4f2f-b24a-94b400631749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41fcd75d-574c-4e68-8777-5c6d101aa7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41fcd75d-574c-4e68-8777-5c6d101aa7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1679391883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bfa6417-0fd6-43c6-a911-bb7c9bfce745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc47150994dc4cf99b38988c5ecd270e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:03:20Z,use_quota=True,user_id='3cdc618fb0754a6e9cd9dd27fda51f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e22663e5-6679-46c0-9f7e-06d310c7d7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e22663e5-6679-46c0-9f7e-06d310c7d7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e6a382-ce4a-4edf-bb99-84b9273e58f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e6a382-ce4a-4edf-bb99-84b9273e58f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bfa6417-0fd6-43c6-a911-bb7c9bfce745', 'volume_name': 'volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4da7dd6-9ab0-47ca-9be4-608626585216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4da7dd6-9ab0-47ca-9be4-608626585216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acbabee7-95a8-44e8-80ef-aab19363a22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:20 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Volume 1bfa6417-0fd6-43c6-a911-bb7c9bfce745: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745', 'volume_size': 1} Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1679391883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bfa6417-0fd6-43c6-a911-bb7c9bfce745,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc47150994dc4cf99b38988c5ecd270e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:03:20Z,use_quota=True,user_id='3cdc618fb0754a6e9cd9dd27fda51f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Creating volume 1bfa6417-0fd6-43c6-a911-bb7c9bfce745 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:03:20 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:20 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745 1073741824 Sep 21 12:03:20 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:20 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-15ff557a-4efd-497b-9243-5b2d39647cf0 tempest-TestInstancesWithCinderVolumes-1667789699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3cea9e23-0d1a-460f-9034-335eb9cf0a31" returned: 0 in 0.435s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-15ff557a-4efd-497b-9243-5b2d39647cf0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "cinder-quobyte-3cea9e23-0d1a-460f-9034-335eb9cf0a31" released by "delete_volume" :: held 1.277s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:20 devstack cinder-volume[86366]: WARNING cinder.quota [None req-15ff557a-4efd-497b-9243-5b2d39647cf0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1866393670-1172049494 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1866393670-1172049494, it is now deprecated. Please use the default quota class for default quota. Sep 21 12:03:20 devstack cinder-volume[86366]: WARNING cinder.quota [None req-15ff557a-4efd-497b-9243-5b2d39647cf0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1866393670-1172049494 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1866393670-1172049494, it is now deprecated. Please use the default quota class for default quota. Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-15ff557a-4efd-497b-9243-5b2d39647cf0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Created reservations ['27be70c1-2eaa-40eb-aa07-4d48c0bad2ad', '22b9921d-49a2-464b-9b00-261db552deb1', '5fb2f2ff-718c-4414-aff7-b1266691c696', 'c79e1ebc-8228-486c-b75b-fc39127a413a'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-15ff557a-4efd-497b-9243-5b2d39647cf0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-15ff557a-4efd-497b-9243-5b2d39647cf0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-15ff557a-4efd-497b-9243-5b2d39647cf0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-15ff557a-4efd-497b-9243-5b2d39647cf0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-15ff557a-4efd-497b-9243-5b2d39647cf0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-15ff557a-4efd-497b-9243-5b2d39647cf0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:21 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:03:21 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:21 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745 1073741824" returned: 0 in 0.937s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:21 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-15ff557a-4efd-497b-9243-5b2d39647cf0 tempest-TestInstancesWithCinderVolumes-1667789699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.498s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:21 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-15ff557a-4efd-497b-9243-5b2d39647cf0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:03:21 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-15ff557a-4efd-497b-9243-5b2d39647cf0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Deleted volume successfully. Sep 21 12:03:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-15ff557a-4efd-497b-9243-5b2d39647cf0 tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "cinder-3cea9e23-0d1a-460f-9034-335eb9cf0a31-delete_volume" released by "delete_volume" :: held 2.317s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:21 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745 Sep 21 12:03:21 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:21 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745" returned: 0 in 0.329s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:21 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:03:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acbabee7-95a8-44e8-80ef-aab19363a22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246fab13-e24e-4898-aedb-2804c31d59f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:21 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Volume volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745 (1bfa6417-0fd6-43c6-a911-bb7c9bfce745): created successfully Sep 21 12:03:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246fab13-e24e-4898-aedb-2804c31d59f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Flow 'volume_create_manager' (6437fa66-0beb-4f2f-b24a-94b400631749) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:03:21 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-0e6f6381-e58f-42f1-8423-3b9e93fba6a4 tempest-VolumesDeleteCascade-1232314083 None] Created volume successfully. Sep 21 12:03:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-53429037-f5d6-4ca3-8f73-f5b4e4ab5fc6 tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-53429037-f5d6-4ca3-8f73-f5b4e4ab5fc6 tempest-VolumesDeleteCascade-1232314083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-53429037-f5d6-4ca3-8f73-f5b4e4ab5fc6 tempest-VolumesDeleteCascade-1232314083 None] Creating offline snapshot cba13a2d-bf34-44f7-86cf-0e1095ceb043 of volume 1bfa6417-0fd6-43c6-a911-bb7c9bfce745 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:03:22 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[824dac46-980b-4d91-9c28-f35a0e48d365]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:03:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-53429037-f5d6-4ca3-8f73-f5b4e4ab5fc6 tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:22 devstack sudo[99314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745 Sep 21 12:03:22 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:23 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-53429037-f5d6-4ca3-8f73-f5b4e4ab5fc6 tempest-VolumesDeleteCascade-1232314083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745" returned: 0 in 0.466s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-53429037-f5d6-4ca3-8f73-f5b4e4ab5fc6 tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.cba13a2d-bf34-44f7-86cf-0e1095ceb043 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:23 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.cba13a2d-bf34-44f7-86cf-0e1095ceb043 1G Sep 21 12:03:23 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:24 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-53429037-f5d6-4ca3-8f73-f5b4e4ab5fc6 tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.cba13a2d-bf34-44f7-86cf-0e1095ceb043 1G" returned: 0 in 0.681s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-53429037-f5d6-4ca3-8f73-f5b4e4ab5fc6 tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.cba13a2d-bf34-44f7-86cf-0e1095ceb043 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:24 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.cba13a2d-bf34-44f7-86cf-0e1095ceb043 Sep 21 12:03:24 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:24 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:03:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Flow 'volume_create_manager' (47f85f5c-ac0d-47c2-9afa-45ff2e139c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:03:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a52c08-cc49-4eca-bf45-ba12ac896555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a52c08-cc49-4eca-bf45-ba12ac896555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1274271394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b711d89f-4be8-43cf-8030-5b83838c95a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef91b0b856bc4167aa30d11fa7f2b1d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:03:24Z,use_quota=True,user_id='a5f06fb99f074be1b1dc5c84a11447c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac36d4c9-5673-4c72-80bc-2e275434a149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac36d4c9-5673-4c72-80bc-2e275434a149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8e15ef-75ab-4f1e-b0a8-64bbdcf73340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8e15ef-75ab-4f1e-b0a8-64bbdcf73340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b711d89f-4be8-43cf-8030-5b83838c95a8', 'volume_name': 'volume-b711d89f-4be8-43cf-8030-5b83838c95a8', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a17ebf2-11bc-435c-a218-9a5f56eb26ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a17ebf2-11bc-435c-a218-9a5f56eb26ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a5bc74d-d30a-4645-a410-84c5aaf6b3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:24 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Volume b711d89f-4be8-43cf-8030-5b83838c95a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b711d89f-4be8-43cf-8030-5b83838c95a8', 'volume_size': 1} Sep 21 12:03:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:24 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-53429037-f5d6-4ca3-8f73-f5b4e4ab5fc6 tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.cba13a2d-bf34-44f7-86cf-0e1095ceb043" returned: 0 in 0.607s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:24 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-53429037-f5d6-4ca3-8f73-f5b4e4ab5fc6 tempest-VolumesDeleteCascade-1232314083 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.cba13a2d-bf34-44f7-86cf-0e1095ceb043 is being set with open permissions: ugo+rw Sep 21 12:03:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-53429037-f5d6-4ca3-8f73-f5b4e4ab5fc6 tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.cba13a2d-bf34-44f7-86cf-0e1095ceb043 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:24 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.cba13a2d-bf34-44f7-86cf-0e1095ceb043 Sep 21 12:03:24 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:24 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-53429037-f5d6-4ca3-8f73-f5b4e4ab5fc6 tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.cba13a2d-bf34-44f7-86cf-0e1095ceb043" returned: 0 in 0.316s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-53429037-f5d6-4ca3-8f73-f5b4e4ab5fc6 tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:25 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.info Sep 21 12:03:25 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:25 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-53429037-f5d6-4ca3-8f73-f5b4e4ab5fc6 tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.info" returned: 0 in 0.293s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:25 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-53429037-f5d6-4ca3-8f73-f5b4e4ab5fc6 tempest-VolumesDeleteCascade-1232314083 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.info is being set with open permissions: ugo+rw Sep 21 12:03:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-53429037-f5d6-4ca3-8f73-f5b4e4ab5fc6 tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:25 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.info Sep 21 12:03:25 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:25 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-2322679e-5a19-4add-9560-cb2d0fc42ede req-954929b4-a974-4b53-b9cd-a4a9775d6648 tempest-TestInstancesWithCinderVolumes-1667789699 None] Terminate volume connection completed successfully. Sep 21 12:03:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-2322679e-5a19-4add-9560-cb2d0fc42ede req-954929b4-a974-4b53-b9cd-a4a9775d6648 tempest-TestInstancesWithCinderVolumes-1667789699 None] Deleting attachment 2c6b761a-a8ba-459e-8039-5fde7e0c3f08. {{(pid=86366) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 12:03:25 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-53429037-f5d6-4ca3-8f73-f5b4e4ab5fc6 tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.info" returned: 0 in 0.372s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-53429037-f5d6-4ca3-8f73-f5b4e4ab5fc6 tempest-VolumesDeleteCascade-1232314083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.926s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.425s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:25 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1274271394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b711d89f-4be8-43cf-8030-5b83838c95a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef91b0b856bc4167aa30d11fa7f2b1d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:03:24Z,use_quota=True,user_id='a5f06fb99f074be1b1dc5c84a11447c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:03:25 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Creating volume b711d89f-4be8-43cf-8030-5b83838c95a8 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:03:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:25 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:03:25 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:03:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:25 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:03:25 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:03:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:25 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8 1073741824 Sep 21 12:03:25 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:25 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-53429037-f5d6-4ca3-8f73-f5b4e4ab5fc6 tempest-VolumesDeleteCascade-1232314083 None] Create snapshot completed successfully Sep 21 12:03:26 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8 1073741824" returned: 0 in 0.720s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:26 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8 Sep 21 12:03:26 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:26 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8" returned: 0 in 0.272s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a5bc74d-d30a-4645-a410-84c5aaf6b3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b711d89f-4be8-43cf-8030-5b83838c95a8', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff838315-d754-48b1-a9ed-6c8509008617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Flow 'volume_create_manager' (8a04e53c-bf9f-41aa-aca3-2794e7a2139b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (567d857e-01d4-42e7-a45c-ce3e9e1aa0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:26 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Volume volume-b711d89f-4be8-43cf-8030-5b83838c95a8 (b711d89f-4be8-43cf-8030-5b83838c95a8): created successfully Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff838315-d754-48b1-a9ed-6c8509008617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Flow 'volume_create_manager' (47f85f5c-ac0d-47c2-9afa-45ff2e139c20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (567d857e-01d4-42e7-a45c-ce3e9e1aa0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1617593351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bb2663f-d122-4b32-b179-15bf8f678c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc47150994dc4cf99b38988c5ecd270e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cba13a2d-bf34-44f7-86cf-0e1095ceb043,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:03:27Z,use_quota=True,user_id='3cdc618fb0754a6e9cd9dd27fda51f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3757be8-47d1-4aec-ab68-0d3ddb192bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3757be8-47d1-4aec-ab68-0d3ddb192bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde96bca-41d6-4e98-b402-d6502234e559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde96bca-41d6-4e98-b402-d6502234e559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7bb2663f-d122-4b32-b179-15bf8f678c7c', 'volume_name': 'volume-7bb2663f-d122-4b32-b179-15bf8f678c7c', 'volume_size': 1, 'snapshot_id': 'cba13a2d-bf34-44f7-86cf-0e1095ceb043'}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c13abcc-7ba0-4b07-a7b2-78cb6aa6a68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c13abcc-7ba0-4b07-a7b2-78cb6aa6a68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38c4d94-7419-4ffc-952a-415d20227c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:26 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Volume 7bb2663f-d122-4b32-b179-15bf8f678c7c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7bb2663f-d122-4b32-b179-15bf8f678c7c', 'volume_size': 1, 'snapshot_id': 'cba13a2d-bf34-44f7-86cf-0e1095ceb043'} Sep 21 12:03:26 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-c5e95705-eacc-48d2-8d30-ce4a20420a9e tempest-SnapshotMetadataTestJSON-1134914697 None] Created volume successfully. Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "cinder-quobyte-cba13a2d-bf34-44f7-86cf-0e1095ceb043-7bb2663f-d122-4b32-b179-15bf8f678c7c" by "_create_volume_from_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-quobyte-cba13a2d-bf34-44f7-86cf-0e1095ceb043-7bb2663f-d122-4b32-b179-15bf8f678c7c" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Creating volume 7bb2663f-d122-4b32-b179-15bf8f678c7c from snapshot cba13a2d-bf34-44f7-86cf-0e1095ceb043 {{(pid=86366) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "cinder-quobyte-7bb2663f-d122-4b32-b179-15bf8f678c7c" by "_copy_volume_from_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-quobyte-7bb2663f-d122-4b32-b179-15bf8f678c7c" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:26 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] snapshot: cba13a2d-bf34-44f7-86cf-0e1095ceb043, volume: 7bb2663f-d122-4b32-b179-15bf8f678c7c, {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 21 12:03:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:03:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:03:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:27 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc748481-a0e3-419d-a9a8-6326b88babbc]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:03:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.cba13a2d-bf34-44f7-86cf-0e1095ceb043 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:27 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-417eb54d-ce00-4acf-a9a3-9746b7afba92 tempest-TestInstancesWithCinderVolumes-1667789699 None] Acquiring lock "cinder-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:27 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-417eb54d-ce00-4acf-a9a3-9746b7afba92 tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "cinder-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:27 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-417eb54d-ce00-4acf-a9a3-9746b7afba92 tempest-TestInstancesWithCinderVolumes-1667789699 None] Acquiring lock "cinder-quobyte-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:27 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-417eb54d-ce00-4acf-a9a3-9746b7afba92 tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "cinder-quobyte-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6" acquired by "delete_volume" :: waited 0.029s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:27 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.cba13a2d-bf34-44f7-86cf-0e1095ceb043 Sep 21 12:03:27 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:27 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfa868f-3657-47e1-bfbc-16dd96644742]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:03:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-417eb54d-ce00-4acf-a9a3-9746b7afba92 tempest-TestInstancesWithCinderVolumes-1667789699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:27 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6 Sep 21 12:03:27 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-42dc47cf-1ac4-4fb5-bbfe-5718e137384a tempest-SnapshotMetadataTestJSON-1134914697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:27 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.cba13a2d-bf34-44f7-86cf-0e1095ceb043" returned: 0 in 0.713s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:03:27 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-417eb54d-ce00-4acf-a9a3-9746b7afba92 tempest-TestInstancesWithCinderVolumes-1667789699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6" returned: 0 in 0.504s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-417eb54d-ce00-4acf-a9a3-9746b7afba92 tempest-TestInstancesWithCinderVolumes-1667789699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:27 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[39721a8d-3614-4106-a872-9de16436a7ae]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:03:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:27 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6 Sep 21 12:03:27 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:27 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745 Sep 21 12:03:27 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:28 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-417eb54d-ce00-4acf-a9a3-9746b7afba92 tempest-TestInstancesWithCinderVolumes-1667789699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6" returned: 0 in 0.288s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:28 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-417eb54d-ce00-4acf-a9a3-9746b7afba92 tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "cinder-quobyte-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6" released by "delete_volume" :: held 0.874s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:28 devstack cinder-volume[86366]: WARNING cinder.quota [None req-417eb54d-ce00-4acf-a9a3-9746b7afba92 tempest-TestInstancesWithCinderVolumes-1667789699 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1671065597-876719071 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1671065597-876719071, it is now deprecated. Please use the default quota class for default quota. Sep 21 12:03:28 devstack cinder-volume[86366]: WARNING cinder.quota [None req-417eb54d-ce00-4acf-a9a3-9746b7afba92 tempest-TestInstancesWithCinderVolumes-1667789699 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1671065597-876719071 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1671065597-876719071, it is now deprecated. Please use the default quota class for default quota. Sep 21 12:03:28 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-417eb54d-ce00-4acf-a9a3-9746b7afba92 tempest-TestInstancesWithCinderVolumes-1667789699 None] Created reservations ['bf19fe1c-2765-459e-b1fc-70e664f0f666', 'a3073475-764b-4f46-b0d5-5acd644dd470', 'a086c964-ad0e-45cb-80c3-2eab6e145044', '7fadc840-7f93-4706-9c5b-c5d427207aaa'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:03:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-417eb54d-ce00-4acf-a9a3-9746b7afba92 tempest-TestInstancesWithCinderVolumes-1667789699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-417eb54d-ce00-4acf-a9a3-9746b7afba92 tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:28 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-417eb54d-ce00-4acf-a9a3-9746b7afba92 tempest-TestInstancesWithCinderVolumes-1667789699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:03:28 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-417eb54d-ce00-4acf-a9a3-9746b7afba92 tempest-TestInstancesWithCinderVolumes-1667789699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:03:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-417eb54d-ce00-4acf-a9a3-9746b7afba92 tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-417eb54d-ce00-4acf-a9a3-9746b7afba92 tempest-TestInstancesWithCinderVolumes-1667789699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:28 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745" returned: 0 in 0.482s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:28 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745 {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 21 12:03:28 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Creating direct copy from snapshot {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 21 12:03:28 devstack cinder-volume[86366]: DEBUG cinder.utils [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Path /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7bb2663f-d122-4b32-b179-15bf8f678c7c not found in is_blk_device check {{(pid=86366) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 21 12:03:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7bb2663f-d122-4b32-b179-15bf8f678c7c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:28 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:03:28 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:28 devstack sudo[99394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7bb2663f-d122-4b32-b179-15bf8f678c7c Sep 21 12:03:28 devstack sudo[99394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:28 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-417eb54d-ce00-4acf-a9a3-9746b7afba92 tempest-TestInstancesWithCinderVolumes-1667789699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.249s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:28 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-417eb54d-ce00-4acf-a9a3-9746b7afba92 tempest-TestInstancesWithCinderVolumes-1667789699 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:03:28 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-417eb54d-ce00-4acf-a9a3-9746b7afba92 tempest-TestInstancesWithCinderVolumes-1667789699 None] Deleted volume successfully. Sep 21 12:03:28 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-417eb54d-ce00-4acf-a9a3-9746b7afba92 tempest-TestInstancesWithCinderVolumes-1667789699 None] Lock "cinder-da0c5c12-cfb9-4e3b-af3c-7cfc70a0b7c6-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:36 devstack sudo[99394]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7bb2663f-d122-4b32-b179-15bf8f678c7c" returned: 0 in 7.976s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:36 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Image conversion details: src /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745, size 1024.00 MB, duration 7.98 sec, destination /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7bb2663f-d122-4b32-b179-15bf8f678c7c {{(pid=86366) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 12:03:36 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Converted 1024.00 MB image at 128.36 MB/s Sep 21 12:03:36 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7bb2663f-d122-4b32-b179-15bf8f678c7c is being set with open permissions: ugo+rw Sep 21 12:03:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7bb2663f-d122-4b32-b179-15bf8f678c7c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:36 devstack sudo[99415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7bb2663f-d122-4b32-b179-15bf8f678c7c Sep 21 12:03:36 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:36 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7bb2663f-d122-4b32-b179-15bf8f678c7c" returned: 0 in 0.300s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:36 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-quobyte-7bb2663f-d122-4b32-b179-15bf8f678c7c" released by "_copy_volume_from_snapshot" :: held 9.587s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:36 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-quobyte-cba13a2d-bf34-44f7-86cf-0e1095ceb043-7bb2663f-d122-4b32-b179-15bf8f678c7c" released by "_create_volume_from_snapshot" :: held 9.676s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.694s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-42dc47cf-1ac4-4fb5-bbfe-5718e137384a tempest-SnapshotMetadataTestJSON-1134914697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.886s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:36 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-42dc47cf-1ac4-4fb5-bbfe-5718e137384a tempest-SnapshotMetadataTestJSON-1134914697 None] Creating offline snapshot aed570c4-fdc4-4bfb-b020-6593d7f5d64a of volume b711d89f-4be8-43cf-8030-5b83838c95a8 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:03:36 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38c4d94-7419-4ffc-952a-415d20227c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bb2663f-d122-4b32-b179-15bf8f678c7c', 'volume_size': 1, 'snapshot_id': 'cba13a2d-bf34-44f7-86cf-0e1095ceb043'}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:36 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (241226d6-af6f-4cf4-be06-2af77f656748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:36 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9d9c99-a0d6-4c12-9fb1-6cb4b0856188]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:03:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-42dc47cf-1ac4-4fb5-bbfe-5718e137384a tempest-SnapshotMetadataTestJSON-1134914697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:36 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Volume volume-7bb2663f-d122-4b32-b179-15bf8f678c7c (7bb2663f-d122-4b32-b179-15bf8f678c7c): created successfully Sep 21 12:03:36 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (241226d6-af6f-4cf4-be06-2af77f656748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:36 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Flow 'volume_create_manager' (8a04e53c-bf9f-41aa-aca3-2794e7a2139b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:03:36 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-a746c293-338a-437e-9749-bd0c8733112c tempest-VolumesDeleteCascade-1232314083 None] Created volume successfully. Sep 21 12:03:36 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8 Sep 21 12:03:36 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:37 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-42dc47cf-1ac4-4fb5-bbfe-5718e137384a tempest-SnapshotMetadataTestJSON-1134914697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8" returned: 0 in 0.443s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-42dc47cf-1ac4-4fb5-bbfe-5718e137384a tempest-SnapshotMetadataTestJSON-1134914697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8.aed570c4-fdc4-4bfb-b020-6593d7f5d64a 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:37 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8.aed570c4-fdc4-4bfb-b020-6593d7f5d64a 1G Sep 21 12:03:37 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:37 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-42dc47cf-1ac4-4fb5-bbfe-5718e137384a tempest-SnapshotMetadataTestJSON-1134914697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8.aed570c4-fdc4-4bfb-b020-6593d7f5d64a 1G" returned: 0 in 0.509s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-42dc47cf-1ac4-4fb5-bbfe-5718e137384a tempest-SnapshotMetadataTestJSON-1134914697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b711d89f-4be8-43cf-8030-5b83838c95a8 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8.aed570c4-fdc4-4bfb-b020-6593d7f5d64a {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:37 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b711d89f-4be8-43cf-8030-5b83838c95a8 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8.aed570c4-fdc4-4bfb-b020-6593d7f5d64a Sep 21 12:03:37 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "cinder-1bfa6417-0fd6-43c6-a911-bb7c9bfce745-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-1bfa6417-0fd6-43c6-a911-bb7c9bfce745-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Performing cascade delete. {{(pid=86366) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 21 12:03:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "cinder-cba13a2d-bf34-44f7-86cf-0e1095ceb043-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-cba13a2d-bf34-44f7-86cf-0e1095ceb043-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:38 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-42dc47cf-1ac4-4fb5-bbfe-5718e137384a tempest-SnapshotMetadataTestJSON-1134914697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b711d89f-4be8-43cf-8030-5b83838c95a8 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8.aed570c4-fdc4-4bfb-b020-6593d7f5d64a" returned: 0 in 0.435s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "cinder-quobyte-1bfa6417-0fd6-43c6-a911-bb7c9bfce745" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:38 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-42dc47cf-1ac4-4fb5-bbfe-5718e137384a tempest-SnapshotMetadataTestJSON-1134914697 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8.aed570c4-fdc4-4bfb-b020-6593d7f5d64a is being set with open permissions: ugo+rw Sep 21 12:03:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-42dc47cf-1ac4-4fb5-bbfe-5718e137384a tempest-SnapshotMetadataTestJSON-1134914697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8.aed570c4-fdc4-4bfb-b020-6593d7f5d64a {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-quobyte-1bfa6417-0fd6-43c6-a911-bb7c9bfce745" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "cinder-quobyte-cba13a2d-bf34-44f7-86cf-0e1095ceb043" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:38 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8.aed570c4-fdc4-4bfb-b020-6593d7f5d64a Sep 21 12:03:38 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-quobyte-cba13a2d-bf34-44f7-86cf-0e1095ceb043" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Deleting offline snapshot cba13a2d-bf34-44f7-86cf-0e1095ceb043 of volume 1bfa6417-0fd6-43c6-a911-bb7c9bfce745 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:03:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] snapshot_file for this snap is: volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.cba13a2d-bf34-44f7-86cf-0e1095ceb043 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:03:38 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd267d4-e638-433d-aaf5-b958fe0f8b99]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:03:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.cba13a2d-bf34-44f7-86cf-0e1095ceb043 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:38 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.cba13a2d-bf34-44f7-86cf-0e1095ceb043 Sep 21 12:03:38 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:38 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-42dc47cf-1ac4-4fb5-bbfe-5718e137384a tempest-SnapshotMetadataTestJSON-1134914697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8.aed570c4-fdc4-4bfb-b020-6593d7f5d64a" returned: 0 in 0.443s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-42dc47cf-1ac4-4fb5-bbfe-5718e137384a tempest-SnapshotMetadataTestJSON-1134914697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:38 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8.info Sep 21 12:03:38 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:38 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.cba13a2d-bf34-44f7-86cf-0e1095ceb043" returned: 0 in 0.599s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:03:38 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[71efc052-2a5e-434e-a731-20c80ece4015]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:03:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:39 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-42dc47cf-1ac4-4fb5-bbfe-5718e137384a tempest-SnapshotMetadataTestJSON-1134914697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8.info" returned: 0 in 0.464s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:39 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-42dc47cf-1ac4-4fb5-bbfe-5718e137384a tempest-SnapshotMetadataTestJSON-1134914697 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8.info is being set with open permissions: ugo+rw Sep 21 12:03:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-42dc47cf-1ac4-4fb5-bbfe-5718e137384a tempest-SnapshotMetadataTestJSON-1134914697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:39 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8.info Sep 21 12:03:39 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:39 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745 Sep 21 12:03:39 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:39 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-42dc47cf-1ac4-4fb5-bbfe-5718e137384a tempest-SnapshotMetadataTestJSON-1134914697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8.info" returned: 0 in 0.411s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-42dc47cf-1ac4-4fb5-bbfe-5718e137384a tempest-SnapshotMetadataTestJSON-1134914697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.858s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:39 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-42dc47cf-1ac4-4fb5-bbfe-5718e137384a tempest-SnapshotMetadataTestJSON-1134914697 None] Create snapshot completed successfully Sep 21 12:03:39 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745" returned: 0 in 0.803s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.cba13a2d-bf34-44f7-86cf-0e1095ceb043 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:39 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.cba13a2d-bf34-44f7-86cf-0e1095ceb043 Sep 21 12:03:39 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:40 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.cba13a2d-bf34-44f7-86cf-0e1095ceb043" returned: 0 in 0.447s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.cba13a2d-bf34-44f7-86cf-0e1095ceb043 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:40 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.cba13a2d-bf34-44f7-86cf-0e1095ceb043 Sep 21 12:03:40 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:40 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745.cba13a2d-bf34-44f7-86cf-0e1095ceb043" returned: 0 in 0.306s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-quobyte-cba13a2d-bf34-44f7-86cf-0e1095ceb043" released by "_delete_snapshot" :: held 2.373s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-quobyte-1bfa6417-0fd6-43c6-a911-bb7c9bfce745" released by "delete_snapshot" :: held 2.414s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:40 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Created reservations ['fa60bc2f-9cba-413e-9577-ed6755a96761', '1017a8d5-7899-4501-992f-2d4c739221b1', '2c7cc16d-fc31-42f7-b79a-98558d8eb5a7', 'b4b01332-841b-425c-b059-3d1b7f59e658'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:03:40 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Delete snapshot completed successfully. Sep 21 12:03:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-cba13a2d-bf34-44f7-86cf-0e1095ceb043-delete_snapshot" released by "delete_snapshot" :: held 2.661s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:40 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Snapshots deleted, issuing volume delete {{(pid=86366) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 21 12:03:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "cinder-quobyte-1bfa6417-0fd6-43c6-a911-bb7c9bfce745" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-quobyte-1bfa6417-0fd6-43c6-a911-bb7c9bfce745" acquired by "delete_volume" :: waited 0.028s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:40 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d6b863-4640-470a-81e3-8416c18c3a4c]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:03:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:40 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745 Sep 21 12:03:40 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:41 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745" returned: 0 in 0.486s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:41 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745 Sep 21 12:03:41 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:41 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1bfa6417-0fd6-43c6-a911-bb7c9bfce745" returned: 0 in 0.338s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:41 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-quobyte-1bfa6417-0fd6-43c6-a911-bb7c9bfce745" released by "delete_volume" :: held 0.938s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:41 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Created reservations ['bcc4d1dc-9a1e-4c22-bbeb-f6ece830084d', 'e24070ff-161e-4fb7-9486-db42157bbe83', '6defed23-a54c-48f1-a69a-b7f3c8218bcd', '2eae47e2-13a4-47b1-8136-f4fd549b18e0'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:03:41 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7a6b50f0-f3ed-4f8c-9e2b-175ea472df9c tempest-SnapshotMetadataTestJSON-1134914697 None] Acquiring lock "cinder-aed570c4-fdc4-4bfb-b020-6593d7f5d64a-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:41 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7a6b50f0-f3ed-4f8c-9e2b-175ea472df9c tempest-SnapshotMetadataTestJSON-1134914697 None] Lock "cinder-aed570c4-fdc4-4bfb-b020-6593d7f5d64a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:41 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7a6b50f0-f3ed-4f8c-9e2b-175ea472df9c tempest-SnapshotMetadataTestJSON-1134914697 None] Acquiring lock "cinder-quobyte-b711d89f-4be8-43cf-8030-5b83838c95a8" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:41 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:03:41 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:03:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:41 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7a6b50f0-f3ed-4f8c-9e2b-175ea472df9c tempest-SnapshotMetadataTestJSON-1134914697 None] Lock "cinder-quobyte-b711d89f-4be8-43cf-8030-5b83838c95a8" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:41 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7a6b50f0-f3ed-4f8c-9e2b-175ea472df9c tempest-SnapshotMetadataTestJSON-1134914697 None] Acquiring lock "cinder-quobyte-aed570c4-fdc4-4bfb-b020-6593d7f5d64a" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:41 devstack sudo[99473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:03:41 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7a6b50f0-f3ed-4f8c-9e2b-175ea472df9c tempest-SnapshotMetadataTestJSON-1134914697 None] Lock "cinder-quobyte-aed570c4-fdc4-4bfb-b020-6593d7f5d64a" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:42 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-7a6b50f0-f3ed-4f8c-9e2b-175ea472df9c tempest-SnapshotMetadataTestJSON-1134914697 None] Deleting offline snapshot aed570c4-fdc4-4bfb-b020-6593d7f5d64a of volume b711d89f-4be8-43cf-8030-5b83838c95a8 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:03:42 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-7a6b50f0-f3ed-4f8c-9e2b-175ea472df9c tempest-SnapshotMetadataTestJSON-1134914697 None] snapshot_file for this snap is: volume-b711d89f-4be8-43cf-8030-5b83838c95a8.aed570c4-fdc4-4bfb-b020-6593d7f5d64a {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:03:42 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[14651806-d121-47b2-9f71-945b9a945b85]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:03:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7a6b50f0-f3ed-4f8c-9e2b-175ea472df9c tempest-SnapshotMetadataTestJSON-1134914697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8.aed570c4-fdc4-4bfb-b020-6593d7f5d64a {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:42 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8.aed570c4-fdc4-4bfb-b020-6593d7f5d64a Sep 21 12:03:42 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:42 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.368s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:42 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:03:42 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Deleted volume successfully. Sep 21 12:03:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fee5817f-e16b-47fe-aad9-f728903ca27e tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-1bfa6417-0fd6-43c6-a911-bb7c9bfce745-delete_volume" released by "delete_volume" :: held 4.404s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-002ba0b4-c56d-45a8-ad44-7dfee38b46d0 tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "cinder-7bb2663f-d122-4b32-b179-15bf8f678c7c-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-002ba0b4-c56d-45a8-ad44-7dfee38b46d0 tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-7bb2663f-d122-4b32-b179-15bf8f678c7c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:42 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7a6b50f0-f3ed-4f8c-9e2b-175ea472df9c tempest-SnapshotMetadataTestJSON-1134914697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8.aed570c4-fdc4-4bfb-b020-6593d7f5d64a" returned: 0 in 0.626s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:42 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-7a6b50f0-f3ed-4f8c-9e2b-175ea472df9c tempest-SnapshotMetadataTestJSON-1134914697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b711d89f-4be8-43cf-8030-5b83838c95a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:03:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-002ba0b4-c56d-45a8-ad44-7dfee38b46d0 tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "cinder-quobyte-7bb2663f-d122-4b32-b179-15bf8f678c7c" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:42 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cebe627-eca2-4526-b6e0-1fd1c9107775]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:03:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7a6b50f0-f3ed-4f8c-9e2b-175ea472df9c tempest-SnapshotMetadataTestJSON-1134914697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-002ba0b4-c56d-45a8-ad44-7dfee38b46d0 tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-quobyte-7bb2663f-d122-4b32-b179-15bf8f678c7c" acquired by "delete_volume" :: waited 0.030s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:42 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1eabe63-27ae-4554-9994-8c4eec588a13]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:03:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-002ba0b4-c56d-45a8-ad44-7dfee38b46d0 tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7bb2663f-d122-4b32-b179-15bf8f678c7c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:42 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8 Sep 21 12:03:42 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:42 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7bb2663f-d122-4b32-b179-15bf8f678c7c Sep 21 12:03:42 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:43 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7a6b50f0-f3ed-4f8c-9e2b-175ea472df9c tempest-SnapshotMetadataTestJSON-1134914697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8" returned: 0 in 0.432s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7a6b50f0-f3ed-4f8c-9e2b-175ea472df9c tempest-SnapshotMetadataTestJSON-1134914697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8.aed570c4-fdc4-4bfb-b020-6593d7f5d64a {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:43 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8.aed570c4-fdc4-4bfb-b020-6593d7f5d64a Sep 21 12:03:43 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:43 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-002ba0b4-c56d-45a8-ad44-7dfee38b46d0 tempest-VolumesDeleteCascade-1232314083 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7bb2663f-d122-4b32-b179-15bf8f678c7c" returned: 0 in 0.477s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-002ba0b4-c56d-45a8-ad44-7dfee38b46d0 tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7bb2663f-d122-4b32-b179-15bf8f678c7c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:43 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7bb2663f-d122-4b32-b179-15bf8f678c7c Sep 21 12:03:43 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:43 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7a6b50f0-f3ed-4f8c-9e2b-175ea472df9c tempest-SnapshotMetadataTestJSON-1134914697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8.aed570c4-fdc4-4bfb-b020-6593d7f5d64a" returned: 0 in 0.385s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7a6b50f0-f3ed-4f8c-9e2b-175ea472df9c tempest-SnapshotMetadataTestJSON-1134914697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8.aed570c4-fdc4-4bfb-b020-6593d7f5d64a {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:43 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8.aed570c4-fdc4-4bfb-b020-6593d7f5d64a Sep 21 12:03:43 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:43 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-002ba0b4-c56d-45a8-ad44-7dfee38b46d0 tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7bb2663f-d122-4b32-b179-15bf8f678c7c" returned: 0 in 0.333s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:43 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-002ba0b4-c56d-45a8-ad44-7dfee38b46d0 tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-quobyte-7bb2663f-d122-4b32-b179-15bf8f678c7c" released by "delete_volume" :: held 0.887s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:43 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-002ba0b4-c56d-45a8-ad44-7dfee38b46d0 tempest-VolumesDeleteCascade-1232314083 None] Created reservations ['ee848246-6842-4faa-babe-3fa6691554e6', 'd04fff85-4204-4678-93ff-181879fbe39d', '0de9c267-1c72-4359-a82e-cc6493424e94', '54ef7d8a-45a0-48ca-8422-f07df21a6a0b'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:03:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-002ba0b4-c56d-45a8-ad44-7dfee38b46d0 tempest-VolumesDeleteCascade-1232314083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-002ba0b4-c56d-45a8-ad44-7dfee38b46d0 tempest-VolumesDeleteCascade-1232314083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:43 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-002ba0b4-c56d-45a8-ad44-7dfee38b46d0 tempest-VolumesDeleteCascade-1232314083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:03:43 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-002ba0b4-c56d-45a8-ad44-7dfee38b46d0 tempest-VolumesDeleteCascade-1232314083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:03:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-002ba0b4-c56d-45a8-ad44-7dfee38b46d0 tempest-VolumesDeleteCascade-1232314083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-002ba0b4-c56d-45a8-ad44-7dfee38b46d0 tempest-VolumesDeleteCascade-1232314083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:44 devstack sudo[99504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:03:44 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:44 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7a6b50f0-f3ed-4f8c-9e2b-175ea472df9c tempest-SnapshotMetadataTestJSON-1134914697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8.aed570c4-fdc4-4bfb-b020-6593d7f5d64a" returned: 0 in 0.499s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:44 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7a6b50f0-f3ed-4f8c-9e2b-175ea472df9c tempest-SnapshotMetadataTestJSON-1134914697 None] Lock "cinder-quobyte-aed570c4-fdc4-4bfb-b020-6593d7f5d64a" released by "_delete_snapshot" :: held 2.133s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:44 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7a6b50f0-f3ed-4f8c-9e2b-175ea472df9c tempest-SnapshotMetadataTestJSON-1134914697 None] Lock "cinder-quobyte-b711d89f-4be8-43cf-8030-5b83838c95a8" released by "delete_snapshot" :: held 2.177s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:44 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-7a6b50f0-f3ed-4f8c-9e2b-175ea472df9c tempest-SnapshotMetadataTestJSON-1134914697 None] Created reservations ['c4b6c2c0-0eb2-4cf4-ab51-cf67fcf53280', 'd24a1a39-10a7-42bf-9be7-ddd10a2fd41b', 'b5afa6e4-1bc7-45e0-a5f0-b523e6f7cdd2', '9088e7c4-7e13-4abe-9aed-6524a8019c48'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:03:44 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-002ba0b4-c56d-45a8-ad44-7dfee38b46d0 tempest-VolumesDeleteCascade-1232314083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.313s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:44 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-002ba0b4-c56d-45a8-ad44-7dfee38b46d0 tempest-VolumesDeleteCascade-1232314083 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:03:44 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-002ba0b4-c56d-45a8-ad44-7dfee38b46d0 tempest-VolumesDeleteCascade-1232314083 None] Deleted volume successfully. Sep 21 12:03:44 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-7a6b50f0-f3ed-4f8c-9e2b-175ea472df9c tempest-SnapshotMetadataTestJSON-1134914697 None] Delete snapshot completed successfully. Sep 21 12:03:44 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-002ba0b4-c56d-45a8-ad44-7dfee38b46d0 tempest-VolumesDeleteCascade-1232314083 None] Lock "cinder-7bb2663f-d122-4b32-b179-15bf8f678c7c-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:44 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7a6b50f0-f3ed-4f8c-9e2b-175ea472df9c tempest-SnapshotMetadataTestJSON-1134914697 None] Lock "cinder-aed570c4-fdc4-4bfb-b020-6593d7f5d64a-delete_snapshot" released by "delete_snapshot" :: held 2.575s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-46188963-860f-42c9-a786-eddbcb279b69 tempest-SnapshotMetadataTestJSON-1134914697 None] Acquiring lock "cinder-b711d89f-4be8-43cf-8030-5b83838c95a8-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-46188963-860f-42c9-a786-eddbcb279b69 tempest-SnapshotMetadataTestJSON-1134914697 None] Lock "cinder-b711d89f-4be8-43cf-8030-5b83838c95a8-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-46188963-860f-42c9-a786-eddbcb279b69 tempest-SnapshotMetadataTestJSON-1134914697 None] Acquiring lock "cinder-quobyte-b711d89f-4be8-43cf-8030-5b83838c95a8" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:03:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-46188963-860f-42c9-a786-eddbcb279b69 tempest-SnapshotMetadataTestJSON-1134914697 None] Lock "cinder-quobyte-b711d89f-4be8-43cf-8030-5b83838c95a8" acquired by "delete_volume" :: waited 0.023s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:03:45 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32500c7-b493-4eb6-8126-31d8588f84eb]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:03:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-46188963-860f-42c9-a786-eddbcb279b69 tempest-SnapshotMetadataTestJSON-1134914697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:45 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8 Sep 21 12:03:45 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:46 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-46188963-860f-42c9-a786-eddbcb279b69 tempest-SnapshotMetadataTestJSON-1134914697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8" returned: 0 in 0.499s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-46188963-860f-42c9-a786-eddbcb279b69 tempest-SnapshotMetadataTestJSON-1134914697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:46 devstack sudo[99513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8 Sep 21 12:03:46 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:46 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-46188963-860f-42c9-a786-eddbcb279b69 tempest-SnapshotMetadataTestJSON-1134914697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b711d89f-4be8-43cf-8030-5b83838c95a8" returned: 0 in 0.326s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:46 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-46188963-860f-42c9-a786-eddbcb279b69 tempest-SnapshotMetadataTestJSON-1134914697 None] Lock "cinder-quobyte-b711d89f-4be8-43cf-8030-5b83838c95a8" released by "delete_volume" :: held 0.940s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:46 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-46188963-860f-42c9-a786-eddbcb279b69 tempest-SnapshotMetadataTestJSON-1134914697 None] Created reservations ['a002d2fa-d8a9-4c39-a947-d5957ba6d1b8', 'd76cd4e8-8d1b-4c2b-8a72-9d0301f33bea', '31f61aa3-c256-46c5-8b43-cf5526dd0c9b', '30db566c-48f4-4131-a53d-c97c727bb745'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:03:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-46188963-860f-42c9-a786-eddbcb279b69 tempest-SnapshotMetadataTestJSON-1134914697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-46188963-860f-42c9-a786-eddbcb279b69 tempest-SnapshotMetadataTestJSON-1134914697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-46188963-860f-42c9-a786-eddbcb279b69 tempest-SnapshotMetadataTestJSON-1134914697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:03:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-46188963-860f-42c9-a786-eddbcb279b69 tempest-SnapshotMetadataTestJSON-1134914697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:03:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-46188963-860f-42c9-a786-eddbcb279b69 tempest-SnapshotMetadataTestJSON-1134914697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-46188963-860f-42c9-a786-eddbcb279b69 tempest-SnapshotMetadataTestJSON-1134914697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:46 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:03:46 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:47 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-46188963-860f-42c9-a786-eddbcb279b69 tempest-SnapshotMetadataTestJSON-1134914697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.425s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:47 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-46188963-860f-42c9-a786-eddbcb279b69 tempest-SnapshotMetadataTestJSON-1134914697 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:03:47 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-46188963-860f-42c9-a786-eddbcb279b69 tempest-SnapshotMetadataTestJSON-1134914697 None] Deleted volume successfully. Sep 21 12:03:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-46188963-860f-42c9-a786-eddbcb279b69 tempest-SnapshotMetadataTestJSON-1134914697 None] Lock "cinder-b711d89f-4be8-43cf-8030-5b83838c95a8-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:03:51 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:03:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Flow 'volume_create_manager' (8b852208-94f0-4afa-908b-56ae075f481e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:03:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc04174a-3fa0-480d-9315-6c1d09cb20bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc04174a-3fa0-480d-9315-6c1d09cb20bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-246205949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa9bd4f-1075-48df-acf5-ea74ff80732e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19a15164bede46b7bcfa9c5357807130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:03:51Z,use_quota=True,user_id='b1846a2bd6214f6592e8a14fc05bccec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb435997-270e-434b-9515-f11bae0a54af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb435997-270e-434b-9515-f11bae0a54af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f53bc1a-9d71-4594-bea9-33783326d794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f53bc1a-9d71-4594-bea9-33783326d794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffa9bd4f-1075-48df-acf5-ea74ff80732e', 'volume_name': 'volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6818b68-da02-43f3-a4d9-7d02c027c649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6818b68-da02-43f3-a4d9-7d02c027c649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f699d890-0114-4978-81fd-659692138554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:51 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Volume ffa9bd4f-1075-48df-acf5-ea74ff80732e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e', 'volume_size': 1} Sep 21 12:03:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-246205949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa9bd4f-1075-48df-acf5-ea74ff80732e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19a15164bede46b7bcfa9c5357807130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:03:51Z,use_quota=True,user_id='b1846a2bd6214f6592e8a14fc05bccec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:03:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Creating volume ffa9bd4f-1075-48df-acf5-ea74ff80732e {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:03:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:03:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:03:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:03:51 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:03:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:51 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e 1073741824 Sep 21 12:03:51 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:52 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e 1073741824" returned: 0 in 0.809s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:52 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=106,cinder:UPDATE=107,cinder:INSERT=26,cinder:DELETE=9 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:03:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:52 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e Sep 21 12:03:52 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:52 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e" returned: 0 in 0.382s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] <== create_volume: return (1310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:03:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:52 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=101,cinder:UPDATE=111,cinder:DELETE=7,cinder:INSERT=30 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:03:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f699d890-0114-4978-81fd-659692138554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28aa625b-c63b-4db8-b6fe-669be693106d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:52 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Volume volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e (ffa9bd4f-1075-48df-acf5-ea74ff80732e): created successfully Sep 21 12:03:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28aa625b-c63b-4db8-b6fe-669be693106d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Flow 'volume_create_manager' (8b852208-94f0-4afa-908b-56ae075f481e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:03:53 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-71647f74-a471-4208-a179-195575aef7ed tempest-CreateVolumesFromSnapshotTest-917914031 None] Created volume successfully. Sep 21 12:03:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3134f7f7-c1c4-429a-8b71-57cba500341c tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3134f7f7-c1c4-429a-8b71-57cba500341c tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:53 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-3134f7f7-c1c4-429a-8b71-57cba500341c tempest-CreateVolumesFromSnapshotTest-917914031 None] Creating offline snapshot d6b0d435-8f9f-4097-aea1-c1eb6b72a5ea of volume ffa9bd4f-1075-48df-acf5-ea74ff80732e {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:03:54 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7c57ce-230c-4df2-ae6e-7d5b6ad50f55]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:03:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3134f7f7-c1c4-429a-8b71-57cba500341c tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:54 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e Sep 21 12:03:54 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:54 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3134f7f7-c1c4-429a-8b71-57cba500341c tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e" returned: 0 in 0.604s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3134f7f7-c1c4-429a-8b71-57cba500341c tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e.d6b0d435-8f9f-4097-aea1-c1eb6b72a5ea 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:54 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e.d6b0d435-8f9f-4097-aea1-c1eb6b72a5ea 1G Sep 21 12:03:54 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:55 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3134f7f7-c1c4-429a-8b71-57cba500341c tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e.d6b0d435-8f9f-4097-aea1-c1eb6b72a5ea 1G" returned: 0 in 0.730s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3134f7f7-c1c4-429a-8b71-57cba500341c tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e.d6b0d435-8f9f-4097-aea1-c1eb6b72a5ea {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:55 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e.d6b0d435-8f9f-4097-aea1-c1eb6b72a5ea Sep 21 12:03:55 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:55 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3134f7f7-c1c4-429a-8b71-57cba500341c tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e.d6b0d435-8f9f-4097-aea1-c1eb6b72a5ea" returned: 0 in 0.470s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:55 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-3134f7f7-c1c4-429a-8b71-57cba500341c tempest-CreateVolumesFromSnapshotTest-917914031 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e.d6b0d435-8f9f-4097-aea1-c1eb6b72a5ea is being set with open permissions: ugo+rw Sep 21 12:03:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3134f7f7-c1c4-429a-8b71-57cba500341c tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e.d6b0d435-8f9f-4097-aea1-c1eb6b72a5ea {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:55 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e.d6b0d435-8f9f-4097-aea1-c1eb6b72a5ea Sep 21 12:03:55 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:56 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3134f7f7-c1c4-429a-8b71-57cba500341c tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e.d6b0d435-8f9f-4097-aea1-c1eb6b72a5ea" returned: 0 in 0.367s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3134f7f7-c1c4-429a-8b71-57cba500341c tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:56 devstack sudo[99586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e.info Sep 21 12:03:56 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:56 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3134f7f7-c1c4-429a-8b71-57cba500341c tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e.info" returned: 0 in 0.447s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:56 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-3134f7f7-c1c4-429a-8b71-57cba500341c tempest-CreateVolumesFromSnapshotTest-917914031 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e.info is being set with open permissions: ugo+rw Sep 21 12:03:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3134f7f7-c1c4-429a-8b71-57cba500341c tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:56 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e.info Sep 21 12:03:56 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:57 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3134f7f7-c1c4-429a-8b71-57cba500341c tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e.info" returned: 0 in 0.485s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3134f7f7-c1c4-429a-8b71-57cba500341c tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.272s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:57 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:03:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Flow 'volume_create_manager' (4ea8846a-1d7e-42e0-bef0-43c57fe9ac4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:03:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a55315-631e-4e32-af21-e17b27c47799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a55315-631e-4e32-af21-e17b27c47799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2003047369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dbeebe0-ebc3-4fc7-8584-0799db1cd63a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6172f4843eee4b20a3389d3d182d7b09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:03:57Z,use_quota=True,user_id='76f49a92224b48ce96af1ca619a3e330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e2556d-4b14-4bee-af9d-d5c43c206c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04e2556d-4b14-4bee-af9d-d5c43c206c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f229fa47-3852-4000-b90c-3c9f98a9cb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f229fa47-3852-4000-b90c-3c9f98a9cb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dbeebe0-ebc3-4fc7-8584-0799db1cd63a', 'volume_name': 'volume-0dbeebe0-ebc3-4fc7-8584-0799db1cd63a', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (517b2b46-875b-4be3-b6d9-125ab9a3c3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (517b2b46-875b-4be3-b6d9-125ab9a3c3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c10ab91-7898-465a-a0be-eb18276743af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:57 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Volume 0dbeebe0-ebc3-4fc7-8584-0799db1cd63a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dbeebe0-ebc3-4fc7-8584-0799db1cd63a', 'volume_size': 1} Sep 21 12:03:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2003047369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dbeebe0-ebc3-4fc7-8584-0799db1cd63a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6172f4843eee4b20a3389d3d182d7b09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:03:57Z,use_quota=True,user_id='76f49a92224b48ce96af1ca619a3e330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:03:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Creating volume 0dbeebe0-ebc3-4fc7-8584-0799db1cd63a {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:03:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:03:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:03:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:03:57 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:03:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0dbeebe0-ebc3-4fc7-8584-0799db1cd63a 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:57 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-3134f7f7-c1c4-429a-8b71-57cba500341c tempest-CreateVolumesFromSnapshotTest-917914031 None] Create snapshot completed successfully Sep 21 12:03:57 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0dbeebe0-ebc3-4fc7-8584-0799db1cd63a 1073741824 Sep 21 12:03:57 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:58 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0dbeebe0-ebc3-4fc7-8584-0799db1cd63a 1073741824" returned: 0 in 0.628s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0dbeebe0-ebc3-4fc7-8584-0799db1cd63a {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:58 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0dbeebe0-ebc3-4fc7-8584-0799db1cd63a Sep 21 12:03:58 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:58 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Sep 21 12:03:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0dbeebe0-ebc3-4fc7-8584-0799db1cd63a" returned: 0 in 0.327s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:03:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:03:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c10ab91-7898-465a-a0be-eb18276743af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dbeebe0-ebc3-4fc7-8584-0799db1cd63a', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1253d663-c194-402b-8895-0bbe5cea939e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:58 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Volume volume-0dbeebe0-ebc3-4fc7-8584-0799db1cd63a (0dbeebe0-ebc3-4fc7-8584-0799db1cd63a): created successfully Sep 21 12:03:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1253d663-c194-402b-8895-0bbe5cea939e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Flow 'volume_create_manager' (4ea8846a-1d7e-42e0-bef0-43c57fe9ac4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:03:58 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-3facfad1-a8cd-4d47-8341-bd3d9e38483c tempest-VolumesTransfersV357Test-1331588160 None] Created volume successfully. Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Flow 'volume_create_manager' (9c9ed161-65de-4cdb-bf21-3712557a2c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (724d0396-4a1f-4c6a-915a-b96ee0ab49c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (724d0396-4a1f-4c6a-915a-b96ee0ab49c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1611599686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d59938f-b4dd-41f0-9592-b6edd5cf421f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19a15164bede46b7bcfa9c5357807130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:03:59Z,use_quota=True,user_id='b1846a2bd6214f6592e8a14fc05bccec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de85bf3-fed9-43e7-8334-0d3211854822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1de85bf3-fed9-43e7-8334-0d3211854822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0425c2-7c33-42db-bfac-d220c643db91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0425c2-7c33-42db-bfac-d220c643db91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d59938f-b4dd-41f0-9592-b6edd5cf421f', 'volume_name': 'volume-7d59938f-b4dd-41f0-9592-b6edd5cf421f', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f35742-6ac8-4ed6-86d3-ed2311cefd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60f35742-6ac8-4ed6-86d3-ed2311cefd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38abf23f-c247-4aa5-8729-6ebf88958e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:59 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Volume 7d59938f-b4dd-41f0-9592-b6edd5cf421f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d59938f-b4dd-41f0-9592-b6edd5cf421f', 'volume_size': 1} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1611599686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d59938f-b4dd-41f0-9592-b6edd5cf421f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19a15164bede46b7bcfa9c5357807130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:03:59Z,use_quota=True,user_id='b1846a2bd6214f6592e8a14fc05bccec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Creating volume 7d59938f-b4dd-41f0-9592-b6edd5cf421f {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:03:59 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d59938f-b4dd-41f0-9592-b6edd5cf421f 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:03:59 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d59938f-b4dd-41f0-9592-b6edd5cf421f 1073741824 Sep 21 12:03:59 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Flow 'volume_create_manager' (ac15da7e-1864-446a-a76e-00d752bf23aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5602c42d-0437-4728-9ea5-34cbca3a526e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5602c42d-0437-4728-9ea5-34cbca3a526e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1857370766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790f6416-74ac-4209-bc40-8fa12fba85bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19a15164bede46b7bcfa9c5357807130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:04:00Z,use_quota=True,user_id='b1846a2bd6214f6592e8a14fc05bccec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (320819ea-2c3f-4ad4-a7d2-d5dfa20528a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (320819ea-2c3f-4ad4-a7d2-d5dfa20528a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c521f9d-9cef-444e-9a63-cde7ba362347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c521f9d-9cef-444e-9a63-cde7ba362347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '790f6416-74ac-4209-bc40-8fa12fba85bc', 'volume_name': 'volume-790f6416-74ac-4209-bc40-8fa12fba85bc', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21d9212-08fd-4850-aa4c-dc4ccaa7e5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21d9212-08fd-4850-aa4c-dc4ccaa7e5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89c09054-a08e-417d-a3a3-4d15ebf002a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:03:59 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Volume 790f6416-74ac-4209-bc40-8fa12fba85bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-790f6416-74ac-4209-bc40-8fa12fba85bc', 'volume_size': 1} Sep 21 12:03:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:00 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:04:00 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Flow 'volume_create_manager' (11fbf221-7d6a-4862-b48b-fccdc23b5e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:04:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (534f9303-522a-4bb1-96db-e941c4eef2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d59938f-b4dd-41f0-9592-b6edd5cf421f 1073741824" returned: 0 in 1.060s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (534f9303-522a-4bb1-96db-e941c4eef2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1601326868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ae8c1a-5170-487e-a32a-6b1b10a0794e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19a15164bede46b7bcfa9c5357807130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:04:00Z,use_quota=True,user_id='b1846a2bd6214f6592e8a14fc05bccec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c3c9fa0-358d-4519-a455-1866557a6951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c3c9fa0-358d-4519-a455-1866557a6951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fceecd0-f5e2-4e9f-8634-ff19fb7de428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fceecd0-f5e2-4e9f-8634-ff19fb7de428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76ae8c1a-5170-487e-a32a-6b1b10a0794e', 'volume_name': 'volume-76ae8c1a-5170-487e-a32a-6b1b10a0794e', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6430eb9c-bca9-4d60-b6f5-e258ed6b7ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6430eb9c-bca9-4d60-b6f5-e258ed6b7ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b67b33e7-b417-42df-b77a-7c36e860c57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:00 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Volume 76ae8c1a-5170-487e-a32a-6b1b10a0794e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76ae8c1a-5170-487e-a32a-6b1b10a0794e', 'volume_size': 1} Sep 21 12:04:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d59938f-b4dd-41f0-9592-b6edd5cf421f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:00 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d59938f-b4dd-41f0-9592-b6edd5cf421f Sep 21 12:04:00 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:04:01 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Flow 'volume_create_manager' (50e27b1c-3a99-4d0a-9f00-efa72db7259f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8dced9-faf6-451b-9041-f2288ac00d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d59938f-b4dd-41f0-9592-b6edd5cf421f" returned: 0 in 0.717s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] <== create_volume: return (1956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.402s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1857370766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790f6416-74ac-4209-bc40-8fa12fba85bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19a15164bede46b7bcfa9c5357807130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:04:00Z,use_quota=True,user_id='b1846a2bd6214f6592e8a14fc05bccec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Creating volume 790f6416-74ac-4209-bc40-8fa12fba85bc {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:04:01 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-790f6416-74ac-4209-bc40-8fa12fba85bc 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd8dced9-faf6-451b-9041-f2288ac00d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1829100249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d9ad650-7cb4-40bb-b3d1-7003b520e12e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19a15164bede46b7bcfa9c5357807130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:04:01Z,use_quota=True,user_id='b1846a2bd6214f6592e8a14fc05bccec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15d3865-36f8-4515-8993-cce291834d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15d3865-36f8-4515-8993-cce291834d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d3f434f-1c17-46ff-9adb-2eeeac0a3e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:01 devstack sudo[99619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-790f6416-74ac-4209-bc40-8fa12fba85bc 1073741824 Sep 21 12:04:01 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d3f434f-1c17-46ff-9adb-2eeeac0a3e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d9ad650-7cb4-40bb-b3d1-7003b520e12e', 'volume_name': 'volume-4d9ad650-7cb4-40bb-b3d1-7003b520e12e', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f294472b-963b-4a7b-b982-a8d86ef3bc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f294472b-963b-4a7b-b982-a8d86ef3bc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de245206-e8d6-4f02-b73b-f4ba913e1fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:01 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Volume 4d9ad650-7cb4-40bb-b3d1-7003b520e12e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d9ad650-7cb4-40bb-b3d1-7003b520e12e', 'volume_size': 1} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38abf23f-c247-4aa5-8729-6ebf88958e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d59938f-b4dd-41f0-9592-b6edd5cf421f', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d297b684-4b29-4ca4-9fbd-ec566f3ba3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:01 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Volume volume-7d59938f-b4dd-41f0-9592-b6edd5cf421f (7d59938f-b4dd-41f0-9592-b6edd5cf421f): created successfully Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d297b684-4b29-4ca4-9fbd-ec566f3ba3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Flow 'volume_create_manager' (9c9ed161-65de-4cdb-bf21-3712557a2c3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:04:01 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-9b1e7a97-3c0a-429b-9bcb-445d68a36be1 tempest-CreateVolumesFromSnapshotTest-917914031 None] Created volume successfully. Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Flow 'volume_create_manager' (f33b81b9-706f-4f8a-ad08-35784c59b8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc0d00e-78bb-405d-80b4-c9169df4af61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:01 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-80a6bff7-7eca-4c98-800a-cd634398e453 tempest-VolumesTransfersV357Test-554260890 None] Transfer volume completed successfully. Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cc0d00e-78bb-405d-80b4-c9169df4af61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-926725037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aadac41-676b-4d93-8e38-3d7ed78f379f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19a15164bede46b7bcfa9c5357807130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:04:02Z,use_quota=True,user_id='b1846a2bd6214f6592e8a14fc05bccec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1682e827-cac6-4241-8482-2bfee498da80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1682e827-cac6-4241-8482-2bfee498da80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6d31f8-5569-4fa6-ab31-77212e26a59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6d31f8-5569-4fa6-ab31-77212e26a59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9aadac41-676b-4d93-8e38-3d7ed78f379f', 'volume_name': 'volume-9aadac41-676b-4d93-8e38-3d7ed78f379f', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6971bb84-ad02-462e-88ec-de1893bf6fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6971bb84-ad02-462e-88ec-de1893bf6fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57eab59-5171-48e8-b457-b5560e96fcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:01 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Volume 9aadac41-676b-4d93-8e38-3d7ed78f379f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9aadac41-676b-4d93-8e38-3d7ed78f379f', 'volume_size': 1} Sep 21 12:04:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:02 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-790f6416-74ac-4209-bc40-8fa12fba85bc 1073741824" returned: 0 in 0.812s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-790f6416-74ac-4209-bc40-8fa12fba85bc {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:02 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-790f6416-74ac-4209-bc40-8fa12fba85bc Sep 21 12:04:02 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:02 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-790f6416-74ac-4209-bc40-8fa12fba85bc" returned: 0 in 0.349s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:04:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.036s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1601326868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ae8c1a-5170-487e-a32a-6b1b10a0794e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19a15164bede46b7bcfa9c5357807130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:04:00Z,use_quota=True,user_id='b1846a2bd6214f6592e8a14fc05bccec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:04:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Creating volume 76ae8c1a-5170-487e-a32a-6b1b10a0794e {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:04:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:04:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:04:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:04:02 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:04:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-76ae8c1a-5170-487e-a32a-6b1b10a0794e 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:02 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a1adfdaa-9a44-42ac-8973-0f828361de83 tempest-VolumesTransfersV357Test-1125628377 None] Acquiring lock "cinder-0dbeebe0-ebc3-4fc7-8584-0799db1cd63a-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:04:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89c09054-a08e-417d-a3a3-4d15ebf002a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-790f6416-74ac-4209-bc40-8fa12fba85bc', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb73dac5-1ee7-449d-af53-2dc16e96e161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:02 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-76ae8c1a-5170-487e-a32a-6b1b10a0794e 1073741824 Sep 21 12:04:02 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:02 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a1adfdaa-9a44-42ac-8973-0f828361de83 tempest-VolumesTransfersV357Test-1125628377 None] Lock "cinder-0dbeebe0-ebc3-4fc7-8584-0799db1cd63a-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:04:02 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Volume volume-790f6416-74ac-4209-bc40-8fa12fba85bc (790f6416-74ac-4209-bc40-8fa12fba85bc): created successfully Sep 21 12:04:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb73dac5-1ee7-449d-af53-2dc16e96e161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Flow 'volume_create_manager' (ac15da7e-1864-446a-a76e-00d752bf23aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:04:02 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-da713b58-c38e-45ba-9da1-79a13cfdfa52 tempest-CreateVolumesFromSnapshotTest-917914031 None] Created volume successfully. Sep 21 12:04:02 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a1adfdaa-9a44-42ac-8973-0f828361de83 tempest-VolumesTransfersV357Test-1125628377 None] Acquiring lock "cinder-quobyte-0dbeebe0-ebc3-4fc7-8584-0799db1cd63a" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:04:02 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a1adfdaa-9a44-42ac-8973-0f828361de83 tempest-VolumesTransfersV357Test-1125628377 None] Lock "cinder-quobyte-0dbeebe0-ebc3-4fc7-8584-0799db1cd63a" acquired by "delete_volume" :: waited 0.025s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:04:02 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[3704b495-ccc4-4b53-a887-e098840bb997]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:04:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a1adfdaa-9a44-42ac-8973-0f828361de83 tempest-VolumesTransfersV357Test-1125628377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0dbeebe0-ebc3-4fc7-8584-0799db1cd63a {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:03 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0dbeebe0-ebc3-4fc7-8584-0799db1cd63a Sep 21 12:04:03 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:03 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-76ae8c1a-5170-487e-a32a-6b1b10a0794e 1073741824" returned: 0 in 0.756s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-76ae8c1a-5170-487e-a32a-6b1b10a0794e {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:03 devstack sudo[99636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-76ae8c1a-5170-487e-a32a-6b1b10a0794e Sep 21 12:04:03 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:03 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a1adfdaa-9a44-42ac-8973-0f828361de83 tempest-VolumesTransfersV357Test-1125628377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0dbeebe0-ebc3-4fc7-8584-0799db1cd63a" returned: 0 in 0.608s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a1adfdaa-9a44-42ac-8973-0f828361de83 tempest-VolumesTransfersV357Test-1125628377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0dbeebe0-ebc3-4fc7-8584-0799db1cd63a {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:03 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0dbeebe0-ebc3-4fc7-8584-0799db1cd63a Sep 21 12:04:03 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:03 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 12:04:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:04:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:04:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:03 devstack sudo[99642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:04:03 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:03 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-76ae8c1a-5170-487e-a32a-6b1b10a0794e" returned: 0 in 0.332s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:04:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.365s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1829100249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d9ad650-7cb4-40bb-b3d1-7003b520e12e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19a15164bede46b7bcfa9c5357807130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:04:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:04:01Z,use_quota=True,user_id='b1846a2bd6214f6592e8a14fc05bccec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:04:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Creating volume 4d9ad650-7cb4-40bb-b3d1-7003b520e12e {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:04:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:04:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:04:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:04:03 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:04:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4d9ad650-7cb4-40bb-b3d1-7003b520e12e 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b67b33e7-b417-42df-b77a-7c36e860c57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76ae8c1a-5170-487e-a32a-6b1b10a0794e', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:03 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4d9ad650-7cb4-40bb-b3d1-7003b520e12e 1073741824 Sep 21 12:04:03 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00ca37f-8ea7-48fd-9c0f-807979deb2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:03 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a1adfdaa-9a44-42ac-8973-0f828361de83 tempest-VolumesTransfersV357Test-1125628377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0dbeebe0-ebc3-4fc7-8584-0799db1cd63a" returned: 0 in 0.379s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:03 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Volume volume-76ae8c1a-5170-487e-a32a-6b1b10a0794e (76ae8c1a-5170-487e-a32a-6b1b10a0794e): created successfully Sep 21 12:04:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c00ca37f-8ea7-48fd-9c0f-807979deb2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Flow 'volume_create_manager' (11fbf221-7d6a-4862-b48b-fccdc23b5e8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a1adfdaa-9a44-42ac-8973-0f828361de83 tempest-VolumesTransfersV357Test-1125628377 None] Lock "cinder-quobyte-0dbeebe0-ebc3-4fc7-8584-0799db1cd63a" released by "delete_volume" :: held 1.100s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:04:04 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-9d4ed15b-b499-4ab4-9cd8-0d9316f67ed5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Created volume successfully. Sep 21 12:04:04 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.418s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-a1adfdaa-9a44-42ac-8973-0f828361de83 tempest-VolumesTransfersV357Test-1125628377 None] Created reservations ['c0e0f5e5-1163-4a9f-a805-b8196716b875', '691c19ce-9fb0-4c46-980d-34915eeb60bc', 'eb70bfc3-5767-4874-b397-912a21635766', '6af83c6c-2fa7-477b-9261-82437f0dbd15'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread count: 28 {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread info: [<_MainThread(MainThread, started 132841976594560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a1adfdaa-9a44-42ac-8973-0f828361de83 tempest-VolumesTransfersV357Test-1125628377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a1adfdaa-9a44-42ac-8973-0f828361de83 tempest-VolumesTransfersV357Test-1125628377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a1adfdaa-9a44-42ac-8973-0f828361de83 tempest-VolumesTransfersV357Test-1125628377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a1adfdaa-9a44-42ac-8973-0f828361de83 tempest-VolumesTransfersV357Test-1125628377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a1adfdaa-9a44-42ac-8973-0f828361de83 tempest-VolumesTransfersV357Test-1125628377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a1adfdaa-9a44-42ac-8973-0f828361de83 tempest-VolumesTransfersV357Test-1125628377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:04 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:04:04 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:04 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4d9ad650-7cb4-40bb-b3d1-7003b520e12e 1073741824" returned: 0 in 0.634s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4d9ad650-7cb4-40bb-b3d1-7003b520e12e {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:04 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4d9ad650-7cb4-40bb-b3d1-7003b520e12e Sep 21 12:04:04 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:04 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a1adfdaa-9a44-42ac-8973-0f828361de83 tempest-VolumesTransfersV357Test-1125628377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.319s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-a1adfdaa-9a44-42ac-8973-0f828361de83 tempest-VolumesTransfersV357Test-1125628377 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:04:04 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-a1adfdaa-9a44-42ac-8973-0f828361de83 tempest-VolumesTransfersV357Test-1125628377 None] Deleted volume successfully. Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a1adfdaa-9a44-42ac-8973-0f828361de83 tempest-VolumesTransfersV357Test-1125628377 None] Lock "cinder-0dbeebe0-ebc3-4fc7-8584-0799db1cd63a-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:04:04 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4d9ad650-7cb4-40bb-b3d1-7003b520e12e" returned: 0 in 0.304s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.014s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-926725037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aadac41-676b-4d93-8e38-3d7ed78f379f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19a15164bede46b7bcfa9c5357807130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:04:02Z,use_quota=True,user_id='b1846a2bd6214f6592e8a14fc05bccec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Creating volume 9aadac41-676b-4d93-8e38-3d7ed78f379f {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:04:04 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9aadac41-676b-4d93-8e38-3d7ed78f379f 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:04 devstack sudo[99658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9aadac41-676b-4d93-8e38-3d7ed78f379f 1073741824 Sep 21 12:04:04 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de245206-e8d6-4f02-b73b-f4ba913e1fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d9ad650-7cb4-40bb-b3d1-7003b520e12e', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d186f9-2b6b-4560-8bc5-2214eb53be1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:04 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Volume volume-4d9ad650-7cb4-40bb-b3d1-7003b520e12e (4d9ad650-7cb4-40bb-b3d1-7003b520e12e): created successfully Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d186f9-2b6b-4560-8bc5-2214eb53be1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Flow 'volume_create_manager' (50e27b1c-3a99-4d0a-9f00-efa72db7259f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:04:04 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-4e414ddf-3590-4891-ae41-8e84bf77b1b9 tempest-CreateVolumesFromSnapshotTest-917914031 None] Created volume successfully. Sep 21 12:04:05 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9aadac41-676b-4d93-8e38-3d7ed78f379f 1073741824" returned: 0 in 0.771s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9aadac41-676b-4d93-8e38-3d7ed78f379f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:05 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9aadac41-676b-4d93-8e38-3d7ed78f379f Sep 21 12:04:05 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:05 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:04:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Flow 'volume_create_manager' (d8b91796-3408-4fa1-a5c7-f70a2dac8c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:04:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e205843-df6e-4aa7-893e-b6a81056c229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e205843-df6e-4aa7-893e-b6a81056c229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-500549064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e4d36ad-954b-47fd-8f3c-97c7aee48cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6172f4843eee4b20a3389d3d182d7b09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:04:06Z,use_quota=True,user_id='76f49a92224b48ce96af1ca619a3e330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0819a56-e4ce-4a87-99eb-4f9fa20fcdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0819a56-e4ce-4a87-99eb-4f9fa20fcdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7896452c-871d-4c2b-9cc3-f217047da454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7896452c-871d-4c2b-9cc3-f217047da454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e4d36ad-954b-47fd-8f3c-97c7aee48cc2', 'volume_name': 'volume-7e4d36ad-954b-47fd-8f3c-97c7aee48cc2', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81dc106e-e985-435f-b9f7-a092dd64927b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81dc106e-e985-435f-b9f7-a092dd64927b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a18c83a-e429-488e-baaa-461a6e0f1acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:05 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Volume 7e4d36ad-954b-47fd-8f3c-97c7aee48cc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e4d36ad-954b-47fd-8f3c-97c7aee48cc2', 'volume_size': 1} Sep 21 12:04:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:06 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9aadac41-676b-4d93-8e38-3d7ed78f379f" returned: 0 in 0.349s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:06 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:04:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.126s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:06 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-500549064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e4d36ad-954b-47fd-8f3c-97c7aee48cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6172f4843eee4b20a3389d3d182d7b09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:04:06Z,use_quota=True,user_id='76f49a92224b48ce96af1ca619a3e330',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:04:06 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Creating volume 7e4d36ad-954b-47fd-8f3c-97c7aee48cc2 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:04:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:06 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:04:06 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:04:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:06 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:04:06 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:04:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7e4d36ad-954b-47fd-8f3c-97c7aee48cc2 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:06 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57eab59-5171-48e8-b457-b5560e96fcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aadac41-676b-4d93-8e38-3d7ed78f379f', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:06 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b94fbe3-2e70-49ec-835c-431a42458471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:06 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7e4d36ad-954b-47fd-8f3c-97c7aee48cc2 1073741824 Sep 21 12:04:06 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:06 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Volume volume-9aadac41-676b-4d93-8e38-3d7ed78f379f (9aadac41-676b-4d93-8e38-3d7ed78f379f): created successfully Sep 21 12:04:06 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b94fbe3-2e70-49ec-835c-431a42458471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:06 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Flow 'volume_create_manager' (f33b81b9-706f-4f8a-ad08-35784c59b8a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:04:06 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-d005a5dd-d4d6-4895-a563-023a1d02a299 tempest-CreateVolumesFromSnapshotTest-917914031 None] Created volume successfully. Sep 21 12:04:06 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6ba34d1e-09ec-4d5c-a15b-6d2ba486e115 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "cinder-9aadac41-676b-4d93-8e38-3d7ed78f379f-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:04:06 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6ba34d1e-09ec-4d5c-a15b-6d2ba486e115 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-9aadac41-676b-4d93-8e38-3d7ed78f379f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:04:06 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6ba34d1e-09ec-4d5c-a15b-6d2ba486e115 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "cinder-quobyte-9aadac41-676b-4d93-8e38-3d7ed78f379f" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:04:06 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6ba34d1e-09ec-4d5c-a15b-6d2ba486e115 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-quobyte-9aadac41-676b-4d93-8e38-3d7ed78f379f" acquired by "delete_volume" :: waited 0.024s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:04:06 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8fa61b-d5bd-434e-a17f-5ce3b8962384]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:04:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6ba34d1e-09ec-4d5c-a15b-6d2ba486e115 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9aadac41-676b-4d93-8e38-3d7ed78f379f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:06 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7e4d36ad-954b-47fd-8f3c-97c7aee48cc2 1073741824" returned: 0 in 0.773s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7e4d36ad-954b-47fd-8f3c-97c7aee48cc2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:06 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9aadac41-676b-4d93-8e38-3d7ed78f379f Sep 21 12:04:06 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:06 devstack sudo[99674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7e4d36ad-954b-47fd-8f3c-97c7aee48cc2 Sep 21 12:04:06 devstack sudo[99674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:07 devstack sudo[99674]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7e4d36ad-954b-47fd-8f3c-97c7aee48cc2" returned: 0 in 0.366s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:04:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:07 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a18c83a-e429-488e-baaa-461a6e0f1acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e4d36ad-954b-47fd-8f3c-97c7aee48cc2', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f512937-a117-46bc-b0b0-98093a36a536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6ba34d1e-09ec-4d5c-a15b-6d2ba486e115 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9aadac41-676b-4d93-8e38-3d7ed78f379f" returned: 0 in 0.519s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6ba34d1e-09ec-4d5c-a15b-6d2ba486e115 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9aadac41-676b-4d93-8e38-3d7ed78f379f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:07 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Volume volume-7e4d36ad-954b-47fd-8f3c-97c7aee48cc2 (7e4d36ad-954b-47fd-8f3c-97c7aee48cc2): created successfully Sep 21 12:04:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f512937-a117-46bc-b0b0-98093a36a536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Flow 'volume_create_manager' (d8b91796-3408-4fa1-a5c7-f70a2dac8c1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:04:07 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9aadac41-676b-4d93-8e38-3d7ed78f379f Sep 21 12:04:07 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:07 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-a7ed214a-d08c-444a-bcef-50e6dff9aafc tempest-VolumesTransfersV357Test-1331588160 None] Created volume successfully. Sep 21 12:04:07 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6ba34d1e-09ec-4d5c-a15b-6d2ba486e115 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9aadac41-676b-4d93-8e38-3d7ed78f379f" returned: 0 in 0.310s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:07 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6ba34d1e-09ec-4d5c-a15b-6d2ba486e115 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-quobyte-9aadac41-676b-4d93-8e38-3d7ed78f379f" released by "delete_volume" :: held 0.907s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:04:07 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-6ba34d1e-09ec-4d5c-a15b-6d2ba486e115 tempest-CreateVolumesFromSnapshotTest-917914031 None] Created reservations ['471ee2aa-9a59-414b-a0bb-e5a4ab1780fb', 'a8c82e46-761a-4034-8015-45b6be7a0757', 'fefb8e6f-d9c7-435c-8f84-34ec6f09e76f', '32caf505-abf8-4329-8c85-2fb826874b84'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:04:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6ba34d1e-09ec-4d5c-a15b-6d2ba486e115 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6ba34d1e-09ec-4d5c-a15b-6d2ba486e115 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6ba34d1e-09ec-4d5c-a15b-6d2ba486e115 tempest-CreateVolumesFromSnapshotTest-917914031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:04:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6ba34d1e-09ec-4d5c-a15b-6d2ba486e115 tempest-CreateVolumesFromSnapshotTest-917914031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:04:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6ba34d1e-09ec-4d5c-a15b-6d2ba486e115 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6ba34d1e-09ec-4d5c-a15b-6d2ba486e115 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:07 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:04:07 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-ae1d365c-d207-4c8d-b49a-1c96454e3004 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "cinder-4d9ad650-7cb4-40bb-b3d1-7003b520e12e-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:04:07 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:07 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-ae1d365c-d207-4c8d-b49a-1c96454e3004 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-4d9ad650-7cb4-40bb-b3d1-7003b520e12e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:04:08 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-ae1d365c-d207-4c8d-b49a-1c96454e3004 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "cinder-quobyte-4d9ad650-7cb4-40bb-b3d1-7003b520e12e" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:04:08 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-ae1d365c-d207-4c8d-b49a-1c96454e3004 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-quobyte-4d9ad650-7cb4-40bb-b3d1-7003b520e12e" acquired by "delete_volume" :: waited 0.019s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:04:08 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2514e5-b877-435e-bfa0-41f9af62f3a8]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:04:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ae1d365c-d207-4c8d-b49a-1c96454e3004 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4d9ad650-7cb4-40bb-b3d1-7003b520e12e {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:08 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4d9ad650-7cb4-40bb-b3d1-7003b520e12e Sep 21 12:04:08 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:08 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6ba34d1e-09ec-4d5c-a15b-6d2ba486e115 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.497s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:08 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-6ba34d1e-09ec-4d5c-a15b-6d2ba486e115 tempest-CreateVolumesFromSnapshotTest-917914031 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:04:08 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-6ba34d1e-09ec-4d5c-a15b-6d2ba486e115 tempest-CreateVolumesFromSnapshotTest-917914031 None] Deleted volume successfully. Sep 21 12:04:08 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6ba34d1e-09ec-4d5c-a15b-6d2ba486e115 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-9aadac41-676b-4d93-8e38-3d7ed78f379f-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:04:08 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b368de0d-099f-41ce-ad4e-a05694485b66 tempest-VolumesTransfersV357Test-1125628377 None] Acquiring lock "cinder-7e4d36ad-954b-47fd-8f3c-97c7aee48cc2-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:04:08 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b368de0d-099f-41ce-ad4e-a05694485b66 tempest-VolumesTransfersV357Test-1125628377 None] Lock "cinder-7e4d36ad-954b-47fd-8f3c-97c7aee48cc2-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:04:08 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b368de0d-099f-41ce-ad4e-a05694485b66 tempest-VolumesTransfersV357Test-1125628377 None] Acquiring lock "cinder-quobyte-7e4d36ad-954b-47fd-8f3c-97c7aee48cc2" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:04:08 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b368de0d-099f-41ce-ad4e-a05694485b66 tempest-VolumesTransfersV357Test-1125628377 None] Lock "cinder-quobyte-7e4d36ad-954b-47fd-8f3c-97c7aee48cc2" acquired by "delete_volume" :: waited 0.029s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:04:08 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88db682-5c26-4d3e-aa99-e754839fdfe8]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:04:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b368de0d-099f-41ce-ad4e-a05694485b66 tempest-VolumesTransfersV357Test-1125628377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7e4d36ad-954b-47fd-8f3c-97c7aee48cc2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:08 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7e4d36ad-954b-47fd-8f3c-97c7aee48cc2 Sep 21 12:04:08 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:08 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ae1d365c-d207-4c8d-b49a-1c96454e3004 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4d9ad650-7cb4-40bb-b3d1-7003b520e12e" returned: 0 in 0.771s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ae1d365c-d207-4c8d-b49a-1c96454e3004 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4d9ad650-7cb4-40bb-b3d1-7003b520e12e {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:08 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4d9ad650-7cb4-40bb-b3d1-7003b520e12e Sep 21 12:04:08 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:09 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b368de0d-099f-41ce-ad4e-a05694485b66 tempest-VolumesTransfersV357Test-1125628377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7e4d36ad-954b-47fd-8f3c-97c7aee48cc2" returned: 0 in 0.507s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b368de0d-099f-41ce-ad4e-a05694485b66 tempest-VolumesTransfersV357Test-1125628377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7e4d36ad-954b-47fd-8f3c-97c7aee48cc2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:09 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7e4d36ad-954b-47fd-8f3c-97c7aee48cc2 Sep 21 12:04:09 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:09 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ae1d365c-d207-4c8d-b49a-1c96454e3004 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4d9ad650-7cb4-40bb-b3d1-7003b520e12e" returned: 0 in 0.372s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-ae1d365c-d207-4c8d-b49a-1c96454e3004 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-quobyte-4d9ad650-7cb4-40bb-b3d1-7003b520e12e" released by "delete_volume" :: held 1.215s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:04:09 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-ae1d365c-d207-4c8d-b49a-1c96454e3004 tempest-CreateVolumesFromSnapshotTest-917914031 None] Created reservations ['53a3de66-bff3-4f47-9fc3-c0d63e08d10a', '95ce17bb-e1da-4898-8118-f5d424207af4', 'bcb8f0bd-bfde-4997-baa1-9fb96006f1d6', 'c286ad3e-5a66-48ef-83fc-a28d88c00c8d'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:04:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-ae1d365c-d207-4c8d-b49a-1c96454e3004 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-ae1d365c-d207-4c8d-b49a-1c96454e3004 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-ae1d365c-d207-4c8d-b49a-1c96454e3004 tempest-CreateVolumesFromSnapshotTest-917914031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:04:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-ae1d365c-d207-4c8d-b49a-1c96454e3004 tempest-CreateVolumesFromSnapshotTest-917914031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:04:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-ae1d365c-d207-4c8d-b49a-1c96454e3004 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ae1d365c-d207-4c8d-b49a-1c96454e3004 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:09 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:04:09 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:09 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b368de0d-099f-41ce-ad4e-a05694485b66 tempest-VolumesTransfersV357Test-1125628377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7e4d36ad-954b-47fd-8f3c-97c7aee48cc2" returned: 0 in 0.414s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b368de0d-099f-41ce-ad4e-a05694485b66 tempest-VolumesTransfersV357Test-1125628377 None] Lock "cinder-quobyte-7e4d36ad-954b-47fd-8f3c-97c7aee48cc2" released by "delete_volume" :: held 0.995s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:04:09 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-b368de0d-099f-41ce-ad4e-a05694485b66 tempest-VolumesTransfersV357Test-1125628377 None] Created reservations ['0d6856bc-d028-4c2e-a1f4-971b92556220', '84a172c3-1f99-41a3-83e6-05b1a6171ab0', '436ead1f-cc2e-416f-8559-4306d16ccef6', 'fd547d4b-7c24-4693-a6db-543c6c59dbe7'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:04:09 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ae1d365c-d207-4c8d-b49a-1c96454e3004 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.387s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:09 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-ae1d365c-d207-4c8d-b49a-1c96454e3004 tempest-CreateVolumesFromSnapshotTest-917914031 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:04:09 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-ae1d365c-d207-4c8d-b49a-1c96454e3004 tempest-CreateVolumesFromSnapshotTest-917914031 None] Deleted volume successfully. Sep 21 12:04:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b368de0d-099f-41ce-ad4e-a05694485b66 tempest-VolumesTransfersV357Test-1125628377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b368de0d-099f-41ce-ad4e-a05694485b66 tempest-VolumesTransfersV357Test-1125628377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b368de0d-099f-41ce-ad4e-a05694485b66 tempest-VolumesTransfersV357Test-1125628377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:04:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b368de0d-099f-41ce-ad4e-a05694485b66 tempest-VolumesTransfersV357Test-1125628377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:04:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b368de0d-099f-41ce-ad4e-a05694485b66 tempest-VolumesTransfersV357Test-1125628377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b368de0d-099f-41ce-ad4e-a05694485b66 tempest-VolumesTransfersV357Test-1125628377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-ae1d365c-d207-4c8d-b49a-1c96454e3004 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-4d9ad650-7cb4-40bb-b3d1-7003b520e12e-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:04:09 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:04:09 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:10 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b368de0d-099f-41ce-ad4e-a05694485b66 tempest-VolumesTransfersV357Test-1125628377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.271s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:10 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-b368de0d-099f-41ce-ad4e-a05694485b66 tempest-VolumesTransfersV357Test-1125628377 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:04:10 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-b368de0d-099f-41ce-ad4e-a05694485b66 tempest-VolumesTransfersV357Test-1125628377 None] Deleted volume successfully. Sep 21 12:04:10 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b368de0d-099f-41ce-ad4e-a05694485b66 tempest-VolumesTransfersV357Test-1125628377 None] Lock "cinder-7e4d36ad-954b-47fd-8f3c-97c7aee48cc2-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:04:10 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c23dcece-84bb-4dcc-a381-d5d04f322cb5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "cinder-76ae8c1a-5170-487e-a32a-6b1b10a0794e-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:04:10 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c23dcece-84bb-4dcc-a381-d5d04f322cb5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-76ae8c1a-5170-487e-a32a-6b1b10a0794e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:04:10 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c23dcece-84bb-4dcc-a381-d5d04f322cb5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "cinder-quobyte-76ae8c1a-5170-487e-a32a-6b1b10a0794e" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:04:10 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c23dcece-84bb-4dcc-a381-d5d04f322cb5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-quobyte-76ae8c1a-5170-487e-a32a-6b1b10a0794e" acquired by "delete_volume" :: waited 0.034s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:04:10 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb08e5d-9b10-420d-9102-b8e0d62e7a75]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:04:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c23dcece-84bb-4dcc-a381-d5d04f322cb5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-76ae8c1a-5170-487e-a32a-6b1b10a0794e {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:10 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-76ae8c1a-5170-487e-a32a-6b1b10a0794e Sep 21 12:04:10 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:10 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c23dcece-84bb-4dcc-a381-d5d04f322cb5 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-76ae8c1a-5170-487e-a32a-6b1b10a0794e" returned: 0 in 0.464s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c23dcece-84bb-4dcc-a381-d5d04f322cb5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-76ae8c1a-5170-487e-a32a-6b1b10a0794e {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:10 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-76ae8c1a-5170-487e-a32a-6b1b10a0794e Sep 21 12:04:10 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:11 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c23dcece-84bb-4dcc-a381-d5d04f322cb5 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-76ae8c1a-5170-487e-a32a-6b1b10a0794e" returned: 0 in 0.385s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c23dcece-84bb-4dcc-a381-d5d04f322cb5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-quobyte-76ae8c1a-5170-487e-a32a-6b1b10a0794e" released by "delete_volume" :: held 0.906s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:04:11 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-c23dcece-84bb-4dcc-a381-d5d04f322cb5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Created reservations ['b497699b-a56d-464c-a712-5c6582d2c2c3', '51d5c81e-38b4-4102-b816-bb179c6132df', '95f14e43-0fb9-4a7b-b837-abda28225a7c', '176b3bb8-c527-4705-9906-f2de6dec6594'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:04:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c23dcece-84bb-4dcc-a381-d5d04f322cb5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c23dcece-84bb-4dcc-a381-d5d04f322cb5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:11 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c23dcece-84bb-4dcc-a381-d5d04f322cb5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:04:11 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c23dcece-84bb-4dcc-a381-d5d04f322cb5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:04:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c23dcece-84bb-4dcc-a381-d5d04f322cb5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c23dcece-84bb-4dcc-a381-d5d04f322cb5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:11 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:04:11 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f9a40c26-38c1-461d-97e8-6a9856c4c255 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "cinder-790f6416-74ac-4209-bc40-8fa12fba85bc-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:04:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f9a40c26-38c1-461d-97e8-6a9856c4c255 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-790f6416-74ac-4209-bc40-8fa12fba85bc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:04:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f9a40c26-38c1-461d-97e8-6a9856c4c255 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "cinder-quobyte-790f6416-74ac-4209-bc40-8fa12fba85bc" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:04:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f9a40c26-38c1-461d-97e8-6a9856c4c255 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-quobyte-790f6416-74ac-4209-bc40-8fa12fba85bc" acquired by "delete_volume" :: waited 0.024s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:04:11 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[977b2445-c7a4-4ab3-9f73-21102681e3d2]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:04:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f9a40c26-38c1-461d-97e8-6a9856c4c255 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-790f6416-74ac-4209-bc40-8fa12fba85bc {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:11 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c23dcece-84bb-4dcc-a381-d5d04f322cb5 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.490s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:11 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-c23dcece-84bb-4dcc-a381-d5d04f322cb5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:04:12 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-c23dcece-84bb-4dcc-a381-d5d04f322cb5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Deleted volume successfully. Sep 21 12:04:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c23dcece-84bb-4dcc-a381-d5d04f322cb5 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-76ae8c1a-5170-487e-a32a-6b1b10a0794e-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:04:12 devstack sudo[99722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-790f6416-74ac-4209-bc40-8fa12fba85bc Sep 21 12:04:12 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:12 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f9a40c26-38c1-461d-97e8-6a9856c4c255 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-790f6416-74ac-4209-bc40-8fa12fba85bc" returned: 0 in 0.630s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f9a40c26-38c1-461d-97e8-6a9856c4c255 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-790f6416-74ac-4209-bc40-8fa12fba85bc {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:12 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-790f6416-74ac-4209-bc40-8fa12fba85bc Sep 21 12:04:12 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:12 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f9a40c26-38c1-461d-97e8-6a9856c4c255 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-790f6416-74ac-4209-bc40-8fa12fba85bc" returned: 0 in 0.391s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f9a40c26-38c1-461d-97e8-6a9856c4c255 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-quobyte-790f6416-74ac-4209-bc40-8fa12fba85bc" released by "delete_volume" :: held 1.105s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:04:12 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-f9a40c26-38c1-461d-97e8-6a9856c4c255 tempest-CreateVolumesFromSnapshotTest-917914031 None] Created reservations ['79e4a525-fc46-4c95-821d-93d64e7d8f1d', 'b1ef85e3-3775-4083-8b57-8466f2975f3d', '4bf3d142-6c2e-417c-903a-d85aa2ad7097', 'adab177f-9de7-495e-a4b2-c8ec88313307'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:04:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f9a40c26-38c1-461d-97e8-6a9856c4c255 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f9a40c26-38c1-461d-97e8-6a9856c4c255 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:13 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f9a40c26-38c1-461d-97e8-6a9856c4c255 tempest-CreateVolumesFromSnapshotTest-917914031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:04:13 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f9a40c26-38c1-461d-97e8-6a9856c4c255 tempest-CreateVolumesFromSnapshotTest-917914031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:04:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f9a40c26-38c1-461d-97e8-6a9856c4c255 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f9a40c26-38c1-461d-97e8-6a9856c4c255 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:13 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:04:13 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:13 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f9a40c26-38c1-461d-97e8-6a9856c4c255 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.309s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:13 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-f9a40c26-38c1-461d-97e8-6a9856c4c255 tempest-CreateVolumesFromSnapshotTest-917914031 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:04:13 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-f9a40c26-38c1-461d-97e8-6a9856c4c255 tempest-CreateVolumesFromSnapshotTest-917914031 None] Deleted volume successfully. Sep 21 12:04:13 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f9a40c26-38c1-461d-97e8-6a9856c4c255 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-790f6416-74ac-4209-bc40-8fa12fba85bc-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2bbfd07d-046e-4f76-8de8-bb85b6427226 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "cinder-7d59938f-b4dd-41f0-9592-b6edd5cf421f-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2bbfd07d-046e-4f76-8de8-bb85b6427226 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-7d59938f-b4dd-41f0-9592-b6edd5cf421f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2bbfd07d-046e-4f76-8de8-bb85b6427226 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "cinder-quobyte-7d59938f-b4dd-41f0-9592-b6edd5cf421f" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2bbfd07d-046e-4f76-8de8-bb85b6427226 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-quobyte-7d59938f-b4dd-41f0-9592-b6edd5cf421f" acquired by "delete_volume" :: waited 0.036s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbcfbca-d2e4-4c9e-bc16-29b4c67731f2]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2bbfd07d-046e-4f76-8de8-bb85b6427226 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d59938f-b4dd-41f0-9592-b6edd5cf421f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:14 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d59938f-b4dd-41f0-9592-b6edd5cf421f Sep 21 12:04:14 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:14 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Flow 'volume_create_manager' (2fdb3cbc-9453-44a0-8213-814b38fcd03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5df5ff4-4ca4-4d72-8cb6-a1d59b842032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2bbfd07d-046e-4f76-8de8-bb85b6427226 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d59938f-b4dd-41f0-9592-b6edd5cf421f" returned: 0 in 0.603s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2bbfd07d-046e-4f76-8de8-bb85b6427226 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d59938f-b4dd-41f0-9592-b6edd5cf421f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5df5ff4-4ca4-4d72-8cb6-a1d59b842032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1866510850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db7f2db4a1134e7f8c37cbf44106cc67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:04:15Z,use_quota=True,user_id='937bcf77be1b4ba0b84a40d22a0c5915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:14 devstack sudo[99739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d59938f-b4dd-41f0-9592-b6edd5cf421f Sep 21 12:04:14 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccdc7c4d-c4ee-486e-b5e5-536d11b45084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccdc7c4d-c4ee-486e-b5e5-536d11b45084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc81cb66-67a4-43ac-bc9e-422ff99b83bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc81cb66-67a4-43ac-bc9e-422ff99b83bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7', 'volume_name': 'volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80732076-edda-4fb1-acd0-4bde20e0733b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80732076-edda-4fb1-acd0-4bde20e0733b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fddff6a-a9ad-4513-8e70-79b33fcd3f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:14 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Volume 4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7', 'volume_size': 1} Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1866510850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db7f2db4a1134e7f8c37cbf44106cc67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:04:15Z,use_quota=True,user_id='937bcf77be1b4ba0b84a40d22a0c5915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Creating volume 4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:04:14 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:04:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:14 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7 1073741824 Sep 21 12:04:14 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:15 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2bbfd07d-046e-4f76-8de8-bb85b6427226 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d59938f-b4dd-41f0-9592-b6edd5cf421f" returned: 0 in 0.431s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:15 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2bbfd07d-046e-4f76-8de8-bb85b6427226 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-quobyte-7d59938f-b4dd-41f0-9592-b6edd5cf421f" released by "delete_volume" :: held 1.108s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:04:15 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-2bbfd07d-046e-4f76-8de8-bb85b6427226 tempest-CreateVolumesFromSnapshotTest-917914031 None] Created reservations ['16ad20ef-7d8a-44ff-8881-ef76b67ff9bf', 'fb8b9b30-e281-4510-b218-2e72e29a6c73', 'db6eb093-f253-4237-b04a-4368d9927888', '29545a20-c44b-4f13-a8b6-711e8effda6f'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:04:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2bbfd07d-046e-4f76-8de8-bb85b6427226 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2bbfd07d-046e-4f76-8de8-bb85b6427226 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:15 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2bbfd07d-046e-4f76-8de8-bb85b6427226 tempest-CreateVolumesFromSnapshotTest-917914031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:04:15 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2bbfd07d-046e-4f76-8de8-bb85b6427226 tempest-CreateVolumesFromSnapshotTest-917914031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:04:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2bbfd07d-046e-4f76-8de8-bb85b6427226 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2bbfd07d-046e-4f76-8de8-bb85b6427226 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:15 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:04:15 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:15 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7 1073741824" returned: 0 in 0.681s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:15 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7 Sep 21 12:04:15 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:15 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2bbfd07d-046e-4f76-8de8-bb85b6427226 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.429s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:15 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-2bbfd07d-046e-4f76-8de8-bb85b6427226 tempest-CreateVolumesFromSnapshotTest-917914031 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:04:15 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-2bbfd07d-046e-4f76-8de8-bb85b6427226 tempest-CreateVolumesFromSnapshotTest-917914031 None] Deleted volume successfully. Sep 21 12:04:15 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2bbfd07d-046e-4f76-8de8-bb85b6427226 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-7d59938f-b4dd-41f0-9592-b6edd5cf421f-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:04:15 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7" returned: 0 in 0.334s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:15 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:04:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fddff6a-a9ad-4513-8e70-79b33fcd3f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dfd88b1-2917-437b-8bda-ad68240ba04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:16 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Volume volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7 (4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7): created successfully Sep 21 12:04:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dfd88b1-2917-437b-8bda-ad68240ba04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Flow 'volume_create_manager' (2fdb3cbc-9453-44a0-8213-814b38fcd03f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:04:16 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-e12630d2-5476-4a91-931d-2f7b5605ff9f tempest-TestImageHashVerification-1631255488 None] Created volume successfully. Sep 21 12:04:16 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1b08fa64-b65a-4426-abd5-140b04436311 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "cinder-d6b0d435-8f9f-4097-aea1-c1eb6b72a5ea-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:04:16 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1b08fa64-b65a-4426-abd5-140b04436311 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-d6b0d435-8f9f-4097-aea1-c1eb6b72a5ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:04:16 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1b08fa64-b65a-4426-abd5-140b04436311 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "cinder-quobyte-ffa9bd4f-1075-48df-acf5-ea74ff80732e" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:04:16 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1b08fa64-b65a-4426-abd5-140b04436311 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-quobyte-ffa9bd4f-1075-48df-acf5-ea74ff80732e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:04:16 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1b08fa64-b65a-4426-abd5-140b04436311 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "cinder-quobyte-d6b0d435-8f9f-4097-aea1-c1eb6b72a5ea" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:04:16 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1b08fa64-b65a-4426-abd5-140b04436311 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-quobyte-d6b0d435-8f9f-4097-aea1-c1eb6b72a5ea" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:04:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1b08fa64-b65a-4426-abd5-140b04436311 tempest-CreateVolumesFromSnapshotTest-917914031 None] Deleting offline snapshot d6b0d435-8f9f-4097-aea1-c1eb6b72a5ea of volume ffa9bd4f-1075-48df-acf5-ea74ff80732e {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:04:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1b08fa64-b65a-4426-abd5-140b04436311 tempest-CreateVolumesFromSnapshotTest-917914031 None] snapshot_file for this snap is: volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e.d6b0d435-8f9f-4097-aea1-c1eb6b72a5ea {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:04:16 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[63981cc5-2ce0-48b2-b36e-6b7977942d12]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:04:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1b08fa64-b65a-4426-abd5-140b04436311 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e.d6b0d435-8f9f-4097-aea1-c1eb6b72a5ea {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:16 devstack sudo[99754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e.d6b0d435-8f9f-4097-aea1-c1eb6b72a5ea Sep 21 12:04:16 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:17 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1b08fa64-b65a-4426-abd5-140b04436311 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e.d6b0d435-8f9f-4097-aea1-c1eb6b72a5ea" returned: 0 in 0.581s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:17 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1b08fa64-b65a-4426-abd5-140b04436311 tempest-CreateVolumesFromSnapshotTest-917914031 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:04:17 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[0192d074-e671-4e3b-9771-70ba467af4f2]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:04:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1b08fa64-b65a-4426-abd5-140b04436311 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:17 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e Sep 21 12:04:17 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:17 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1b08fa64-b65a-4426-abd5-140b04436311 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e" returned: 0 in 0.661s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1b08fa64-b65a-4426-abd5-140b04436311 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e.d6b0d435-8f9f-4097-aea1-c1eb6b72a5ea {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:17 devstack sudo[99764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e.d6b0d435-8f9f-4097-aea1-c1eb6b72a5ea Sep 21 12:04:17 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:18 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1b08fa64-b65a-4426-abd5-140b04436311 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e.d6b0d435-8f9f-4097-aea1-c1eb6b72a5ea" returned: 0 in 0.529s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1b08fa64-b65a-4426-abd5-140b04436311 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e.d6b0d435-8f9f-4097-aea1-c1eb6b72a5ea {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:18 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e.d6b0d435-8f9f-4097-aea1-c1eb6b72a5ea Sep 21 12:04:18 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d5d04023-25a1-44dd-846e-a23564c53f8c tempest-TestImageHashVerification-1631255488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d5d04023-25a1-44dd-846e-a23564c53f8c tempest-TestImageHashVerification-1631255488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:18 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8c6f22-d99d-4af2-aec7-4cc585706bda]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:04:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d5d04023-25a1-44dd-846e-a23564c53f8c tempest-TestImageHashVerification-1631255488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:18 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1b08fa64-b65a-4426-abd5-140b04436311 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e.d6b0d435-8f9f-4097-aea1-c1eb6b72a5ea" returned: 0 in 0.332s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:18 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1b08fa64-b65a-4426-abd5-140b04436311 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-quobyte-d6b0d435-8f9f-4097-aea1-c1eb6b72a5ea" released by "_delete_snapshot" :: held 2.289s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:04:18 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1b08fa64-b65a-4426-abd5-140b04436311 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-quobyte-ffa9bd4f-1075-48df-acf5-ea74ff80732e" released by "delete_snapshot" :: held 2.324s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:04:18 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7 Sep 21 12:04:18 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:18 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-1b08fa64-b65a-4426-abd5-140b04436311 tempest-CreateVolumesFromSnapshotTest-917914031 None] Created reservations ['33048d89-5cff-42be-9579-906d7c449dbb', '55f1bd77-f8f2-430e-b82b-12ab5fe2ac33', 'af2269a1-a1bb-4ede-8f3c-b7f22aa90bcb', 'b1de396b-0722-4e5b-b23b-6ac9b9fcd643'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:04:18 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1b08fa64-b65a-4426-abd5-140b04436311 tempest-CreateVolumesFromSnapshotTest-917914031 None] Delete snapshot completed successfully. Sep 21 12:04:18 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1b08fa64-b65a-4426-abd5-140b04436311 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-d6b0d435-8f9f-4097-aea1-c1eb6b72a5ea-delete_snapshot" released by "delete_snapshot" :: held 2.553s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:04:19 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d5d04023-25a1-44dd-846e-a23564c53f8c tempest-TestImageHashVerification-1631255488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7" returned: 0 in 0.501s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:19 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cf7e45-daeb-465e-ae8a-848a16a61d47]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:04:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d5d04023-25a1-44dd-846e-a23564c53f8c tempest-TestImageHashVerification-1631255488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:19 devstack sudo[99779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7 Sep 21 12:04:19 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:19 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d5d04023-25a1-44dd-846e-a23564c53f8c tempest-TestImageHashVerification-1631255488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7" returned: 0 in 0.461s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d5d04023-25a1-44dd-846e-a23564c53f8c tempest-TestImageHashVerification-1631255488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7 /opt/stack/data/cinder/conversion/4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7.temp_image.0632641e-006a-4e4d-9078-9d8145fc03cem1zv8qkq.img {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:19 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7 /opt/stack/data/cinder/conversion/4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7.temp_image.0632641e-006a-4e4d-9078-9d8145fc03cem1zv8qkq.img Sep 21 12:04:19 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6fe934f6-a3f1-404d-9678-e51240029850 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "cinder-ffa9bd4f-1075-48df-acf5-ea74ff80732e-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:04:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6fe934f6-a3f1-404d-9678-e51240029850 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-ffa9bd4f-1075-48df-acf5-ea74ff80732e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:04:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6fe934f6-a3f1-404d-9678-e51240029850 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "cinder-quobyte-ffa9bd4f-1075-48df-acf5-ea74ff80732e" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:04:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6fe934f6-a3f1-404d-9678-e51240029850 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-quobyte-ffa9bd4f-1075-48df-acf5-ea74ff80732e" acquired by "delete_volume" :: waited 0.029s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:04:19 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb611e19-5338-4fdc-b1d6-50a30bccddf8]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:04:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6fe934f6-a3f1-404d-9678-e51240029850 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:20 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e Sep 21 12:04:20 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:20 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6fe934f6-a3f1-404d-9678-e51240029850 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e" returned: 0 in 1.105s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6fe934f6-a3f1-404d-9678-e51240029850 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:21 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e Sep 21 12:04:21 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:21 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6fe934f6-a3f1-404d-9678-e51240029850 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ffa9bd4f-1075-48df-acf5-ea74ff80732e" returned: 0 in 0.535s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6fe934f6-a3f1-404d-9678-e51240029850 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-quobyte-ffa9bd4f-1075-48df-acf5-ea74ff80732e" released by "delete_volume" :: held 1.760s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:04:21 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-6fe934f6-a3f1-404d-9678-e51240029850 tempest-CreateVolumesFromSnapshotTest-917914031 None] Created reservations ['f2645d0b-9271-4b52-901f-4c5ab835f70e', '7e5eb57c-cca0-42a9-a76e-1c178a26e76a', '9768bfbd-c0f5-4639-afd3-77508b09e520', 'f1dd1d7e-a887-4a2c-b0e9-f8edb0cbc5e6'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:04:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6fe934f6-a3f1-404d-9678-e51240029850 tempest-CreateVolumesFromSnapshotTest-917914031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6fe934f6-a3f1-404d-9678-e51240029850 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:21 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6fe934f6-a3f1-404d-9678-e51240029850 tempest-CreateVolumesFromSnapshotTest-917914031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:04:21 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6fe934f6-a3f1-404d-9678-e51240029850 tempest-CreateVolumesFromSnapshotTest-917914031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:04:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6fe934f6-a3f1-404d-9678-e51240029850 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6fe934f6-a3f1-404d-9678-e51240029850 tempest-CreateVolumesFromSnapshotTest-917914031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:21 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:04:21 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:22 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6fe934f6-a3f1-404d-9678-e51240029850 tempest-CreateVolumesFromSnapshotTest-917914031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.678s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:22 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-6fe934f6-a3f1-404d-9678-e51240029850 tempest-CreateVolumesFromSnapshotTest-917914031 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:04:22 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-6fe934f6-a3f1-404d-9678-e51240029850 tempest-CreateVolumesFromSnapshotTest-917914031 None] Deleted volume successfully. Sep 21 12:04:22 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6fe934f6-a3f1-404d-9678-e51240029850 tempest-CreateVolumesFromSnapshotTest-917914031 None] Lock "cinder-ffa9bd4f-1075-48df-acf5-ea74ff80732e-delete_volume" released by "delete_volume" :: held 2.981s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:04:23 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:04:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Flow 'volume_create_manager' (ef424d87-2613-45a6-a3bf-dadfc8e3602a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:04:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b2b7bd3-ab0a-4d95-bc1c-f2b67d220f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b2b7bd3-ab0a-4d95-bc1c-f2b67d220f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1627941993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=716dad07-4823-4b01-8e8e-33d42a0168c0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c183949a75984aad9712c44ddd7f291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:04:23Z,use_quota=True,user_id='a477515563f342dea8931e50cf28fbc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c221f58-4f68-4feb-9dca-a03eaa79be72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c221f58-4f68-4feb-9dca-a03eaa79be72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af1e00b0-23cf-43aa-990e-75dcba1c0e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af1e00b0-23cf-43aa-990e-75dcba1c0e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '716dad07-4823-4b01-8e8e-33d42a0168c0', 'volume_name': 'volume-716dad07-4823-4b01-8e8e-33d42a0168c0', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec11446e-2477-408b-afd5-cf8ddeae518d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec11446e-2477-408b-afd5-cf8ddeae518d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84923613-dcb7-4875-9cae-40ac9c80e324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:23 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Volume 716dad07-4823-4b01-8e8e-33d42a0168c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-716dad07-4823-4b01-8e8e-33d42a0168c0', 'volume_size': 1} Sep 21 12:04:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:27 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d5d04023-25a1-44dd-846e-a23564c53f8c tempest-TestImageHashVerification-1631255488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7 /opt/stack/data/cinder/conversion/4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7.temp_image.0632641e-006a-4e4d-9078-9d8145fc03cem1zv8qkq.img" returned: 0 in 8.280s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:27 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[da015501-5c8d-41f7-9a66-993c77b93624]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:04:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d5d04023-25a1-44dd-846e-a23564c53f8c tempest-TestImageHashVerification-1631255488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:28 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7 Sep 21 12:04:28 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:28 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d5d04023-25a1-44dd-846e-a23564c53f8c tempest-TestImageHashVerification-1631255488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7" returned: 0 in 0.698s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:28 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-d5d04023-25a1-44dd-846e-a23564c53f8c tempest-TestImageHashVerification-1631255488 None] Image conversion details: src /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7, size 1024.00 MB, duration 8.28 sec, destination /opt/stack/data/cinder/conversion/4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7.temp_image.0632641e-006a-4e4d-9078-9d8145fc03cem1zv8qkq.img {{(pid=86366) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 12:04:28 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-d5d04023-25a1-44dd-846e-a23564c53f8c tempest-TestImageHashVerification-1631255488 None] Converted 1024.00 MB image at 123.65 MB/s Sep 21 12:04:28 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-d5d04023-25a1-44dd-846e-a23564c53f8c tempest-TestImageHashVerification-1631255488 None] 0632641e-006a-4e4d-9078-9d8145fc03ce was raw, no need to convert to raw {{(pid=86366) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 21 12:04:28 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:04:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Flow 'volume_create_manager' (b6f5851a-26fb-412f-9a37-fea25023cd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:04:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b87343d3-107a-4ada-94f2-754cdf837f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b87343d3-107a-4ada-94f2-754cdf837f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1810194375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0063038f-e80b-4aba-9986-b93781a1ccbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c354847598542b28ec16db9496a29b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:04:29Z,use_quota=True,user_id='74d4d5ae356e437a97c5255a72db5920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b60138-5cdc-436f-8de6-65eb1c14cc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b60138-5cdc-436f-8de6-65eb1c14cc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (977387fe-d1ca-45d4-8c35-3b822b087db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (977387fe-d1ca-45d4-8c35-3b822b087db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0063038f-e80b-4aba-9986-b93781a1ccbb', 'volume_name': 'volume-0063038f-e80b-4aba-9986-b93781a1ccbb', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151db4af-1fcb-4da0-b4ca-f9f7d4805e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151db4af-1fcb-4da0-b4ca-f9f7d4805e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6c602f-308b-4445-b8be-3c8216f66a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:29 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Volume 0063038f-e80b-4aba-9986-b93781a1ccbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0063038f-e80b-4aba-9986-b93781a1ccbb', 'volume_size': 1} Sep 21 12:04:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:38 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:UPDATE=103,cinder:DELETE=10,cinder:SELECT=72,cinder:INSERT=22 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:04:39 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:UPDATE=91,cinder:SELECT=66,cinder:DELETE=8,cinder:INSERT=23 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:04:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d5d04023-25a1-44dd-846e-a23564c53f8c tempest-TestImageHashVerification-1631255488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.995s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:53 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d5d04023-25a1-44dd-846e-a23564c53f8c tempest-TestImageHashVerification-1631255488 None] Uploaded volume to glance image-id: 0632641e-006a-4e4d-9078-9d8145fc03ce. {{(pid=86366) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 21 12:04:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 30.159s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:53 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1627941993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=716dad07-4823-4b01-8e8e-33d42a0168c0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c183949a75984aad9712c44ddd7f291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:04:23Z,use_quota=True,user_id='a477515563f342dea8931e50cf28fbc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:04:53 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Creating volume 716dad07-4823-4b01-8e8e-33d42a0168c0 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:04:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:53 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:04:53 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:04:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:53 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:04:53 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:04:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-716dad07-4823-4b01-8e8e-33d42a0168c0 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:53 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-d5d04023-25a1-44dd-846e-a23564c53f8c tempest-TestImageHashVerification-1631255488 None] Copy volume to image completed successfully. Sep 21 12:04:53 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-716dad07-4823-4b01-8e8e-33d42a0168c0 1073741824 Sep 21 12:04:53 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:54 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-716dad07-4823-4b01-8e8e-33d42a0168c0 1073741824" returned: 0 in 0.523s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-716dad07-4823-4b01-8e8e-33d42a0168c0 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:54 devstack sudo[99951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-716dad07-4823-4b01-8e8e-33d42a0168c0 Sep 21 12:04:54 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:54 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-716dad07-4823-4b01-8e8e-33d42a0168c0" returned: 0 in 0.261s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:54 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:04:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.273s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:54 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1810194375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0063038f-e80b-4aba-9986-b93781a1ccbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c354847598542b28ec16db9496a29b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:04:29Z,use_quota=True,user_id='74d4d5ae356e437a97c5255a72db5920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:04:54 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Creating volume 0063038f-e80b-4aba-9986-b93781a1ccbb {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:04:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:54 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:04:54 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:04:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:54 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:04:54 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:04:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84923613-dcb7-4875-9cae-40ac9c80e324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-716dad07-4823-4b01-8e8e-33d42a0168c0', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e41564-acd9-4a12-a110-a164769490af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:54 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb 1073741824 Sep 21 12:04:54 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:54 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Volume volume-716dad07-4823-4b01-8e8e-33d42a0168c0 (716dad07-4823-4b01-8e8e-33d42a0168c0): created successfully Sep 21 12:04:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e41564-acd9-4a12-a110-a164769490af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Flow 'volume_create_manager' (ef424d87-2613-45a6-a3bf-dadfc8e3602a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:04:54 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-f4c8481e-4844-4f0b-91f5-17d541f204f1 tempest-VolumesGetTest-1877134668 None] Created volume successfully. Sep 21 12:04:54 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb 1073741824" returned: 0 in 0.552s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:55 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb Sep 21 12:04:55 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-23634658-9193-4b01-97a3-1e931405ff67 tempest-TestImageHashVerification-1631255488 None] Acquiring lock "cinder-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:04:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-23634658-9193-4b01-97a3-1e931405ff67 tempest-TestImageHashVerification-1631255488 None] Lock "cinder-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:04:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-23634658-9193-4b01-97a3-1e931405ff67 tempest-TestImageHashVerification-1631255488 None] Acquiring lock "cinder-quobyte-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:04:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-23634658-9193-4b01-97a3-1e931405ff67 tempest-TestImageHashVerification-1631255488 None] Lock "cinder-quobyte-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7" acquired by "delete_volume" :: waited 0.025s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:04:55 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[f168221d-ea20-4c85-a955-bbb6930f057c]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:04:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-23634658-9193-4b01-97a3-1e931405ff67 tempest-TestImageHashVerification-1631255488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:55 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb" returned: 0 in 0.460s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:55 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:04:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:55 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e6c602f-308b-4445-b8be-3c8216f66a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0063038f-e80b-4aba-9986-b93781a1ccbb', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:55 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26c2d330-0ebb-4b32-8433-2f04f11c1aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:55 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Volume volume-0063038f-e80b-4aba-9986-b93781a1ccbb (0063038f-e80b-4aba-9986-b93781a1ccbb): created successfully Sep 21 12:04:55 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26c2d330-0ebb-4b32-8433-2f04f11c1aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:55 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Flow 'volume_create_manager' (b6f5851a-26fb-412f-9a37-fea25023cd54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:04:55 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7 Sep 21 12:04:55 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:55 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-792fea2f-83de-4566-90d8-f16421798fb6 tempest-VolumeDependencyTests-765505224 None] Created volume successfully. Sep 21 12:04:55 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-23634658-9193-4b01-97a3-1e931405ff67 tempest-TestImageHashVerification-1631255488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7" returned: 0 in 0.439s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-23634658-9193-4b01-97a3-1e931405ff67 tempest-TestImageHashVerification-1631255488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:55 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7 Sep 21 12:04:55 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:56 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-23634658-9193-4b01-97a3-1e931405ff67 tempest-TestImageHashVerification-1631255488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7" returned: 0 in 0.299s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-23634658-9193-4b01-97a3-1e931405ff67 tempest-TestImageHashVerification-1631255488 None] Lock "cinder-quobyte-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7" released by "delete_volume" :: held 0.825s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Flow 'volume_create_manager' (990ca108-023d-4b98-ab59-3bbbe582b49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec81536-3eb9-4afd-899d-e6da164363c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec81536-3eb9-4afd-899d-e6da164363c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:04:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-525689241',display_name='tempest-VolumesGetTest-Volume-338570760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f120cb00-7d7d-4306-9f5e-ae90481d145c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c183949a75984aad9712c44ddd7f291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:04:56Z,use_quota=True,user_id='a477515563f342dea8931e50cf28fbc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d9d9f95-654b-4ed4-87e9-a6c2dfeec1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d9d9f95-654b-4ed4-87e9-a6c2dfeec1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a243221-8697-4035-9d46-475593ab84e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a243221-8697-4035-9d46-475593ab84e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f120cb00-7d7d-4306-9f5e-ae90481d145c', 'volume_name': 'volume-f120cb00-7d7d-4306-9f5e-ae90481d145c', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e188ba93-24d7-4870-b69e-b05966653996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e188ba93-24d7-4870-b69e-b05966653996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c81245c-1574-4bdd-8d69-ed1259e5c795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:56 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Volume f120cb00-7d7d-4306-9f5e-ae90481d145c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f120cb00-7d7d-4306-9f5e-ae90481d145c', 'volume_size': 1} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:04:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-525689241',display_name='tempest-VolumesGetTest-Volume-338570760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f120cb00-7d7d-4306-9f5e-ae90481d145c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c183949a75984aad9712c44ddd7f291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:04:56Z,use_quota=True,user_id='a477515563f342dea8931e50cf28fbc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Creating volume f120cb00-7d7d-4306-9f5e-ae90481d145c {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:04:56 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f120cb00-7d7d-4306-9f5e-ae90481d145c 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:56 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f120cb00-7d7d-4306-9f5e-ae90481d145c 1073741824 Sep 21 12:04:56 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-23634658-9193-4b01-97a3-1e931405ff67 tempest-TestImageHashVerification-1631255488 None] Created reservations ['9855279c-292a-41f5-ba0b-eedbfe27fe7b', '41b46c3c-12a2-45aa-ab1e-01a9afa2342f', '7f6400be-0211-43f6-86fb-d7d80fb36197', 'd40031da-5859-47e1-a435-773608f9bf0c'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-23634658-9193-4b01-97a3-1e931405ff67 tempest-TestImageHashVerification-1631255488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-23634658-9193-4b01-97a3-1e931405ff67 tempest-TestImageHashVerification-1631255488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-23634658-9193-4b01-97a3-1e931405ff67 tempest-TestImageHashVerification-1631255488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-23634658-9193-4b01-97a3-1e931405ff67 tempest-TestImageHashVerification-1631255488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-23634658-9193-4b01-97a3-1e931405ff67 tempest-TestImageHashVerification-1631255488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-23634658-9193-4b01-97a3-1e931405ff67 tempest-TestImageHashVerification-1631255488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:56 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:04:56 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6c3a6df7-d023-4a8c-9b6e-0c621cea94ab tempest-VolumeDependencyTests-765505224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:56 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-23634658-9193-4b01-97a3-1e931405ff67 tempest-TestImageHashVerification-1631255488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.299s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-23634658-9193-4b01-97a3-1e931405ff67 tempest-TestImageHashVerification-1631255488 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:04:56 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-23634658-9193-4b01-97a3-1e931405ff67 tempest-TestImageHashVerification-1631255488 None] Deleted volume successfully. Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-23634658-9193-4b01-97a3-1e931405ff67 tempest-TestImageHashVerification-1631255488 None] Lock "cinder-4ac7938f-c3aa-4e9f-ba4b-e5ee4a426ec7-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:04:56 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f120cb00-7d7d-4306-9f5e-ae90481d145c 1073741824" returned: 0 in 0.634s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f120cb00-7d7d-4306-9f5e-ae90481d145c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:57 devstack sudo[100015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f120cb00-7d7d-4306-9f5e-ae90481d145c Sep 21 12:04:57 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:57 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f120cb00-7d7d-4306-9f5e-ae90481d145c" returned: 0 in 0.280s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:04:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6c3a6df7-d023-4a8c-9b6e-0c621cea94ab tempest-VolumeDependencyTests-765505224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.681s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c81245c-1574-4bdd-8d69-ed1259e5c795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f120cb00-7d7d-4306-9f5e-ae90481d145c', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176f6d92-25d9-458b-9dc3-1550043d57fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:04:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-6c3a6df7-d023-4a8c-9b6e-0c621cea94ab tempest-VolumeDependencyTests-765505224 None] Creating offline snapshot b04b26dc-8506-4adf-83f9-b39c196483c4 of volume 0063038f-e80b-4aba-9986-b93781a1ccbb {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:04:57 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Volume volume-f120cb00-7d7d-4306-9f5e-ae90481d145c (f120cb00-7d7d-4306-9f5e-ae90481d145c): created successfully Sep 21 12:04:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176f6d92-25d9-458b-9dc3-1550043d57fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:04:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Flow 'volume_create_manager' (990ca108-023d-4b98-ab59-3bbbe582b49b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:04:57 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[2618db62-fdee-419d-b15f-7d7703d43e6b]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:04:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6c3a6df7-d023-4a8c-9b6e-0c621cea94ab tempest-VolumeDependencyTests-765505224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:57 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-fe58b34e-8d5b-4ba2-808d-c274fee1a254 tempest-VolumesGetTest-1877134668 None] Created volume successfully. Sep 21 12:04:57 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb Sep 21 12:04:57 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:57 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6c3a6df7-d023-4a8c-9b6e-0c621cea94ab tempest-VolumeDependencyTests-765505224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb" returned: 0 in 0.451s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6c3a6df7-d023-4a8c-9b6e-0c621cea94ab tempest-VolumeDependencyTests-765505224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.b04b26dc-8506-4adf-83f9-b39c196483c4 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:57 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.b04b26dc-8506-4adf-83f9-b39c196483c4 1G Sep 21 12:04:57 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:58 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6c3a6df7-d023-4a8c-9b6e-0c621cea94ab tempest-VolumeDependencyTests-765505224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.b04b26dc-8506-4adf-83f9-b39c196483c4 1G" returned: 0 in 0.522s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6c3a6df7-d023-4a8c-9b6e-0c621cea94ab tempest-VolumeDependencyTests-765505224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0063038f-e80b-4aba-9986-b93781a1ccbb -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.b04b26dc-8506-4adf-83f9-b39c196483c4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:58 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0063038f-e80b-4aba-9986-b93781a1ccbb -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.b04b26dc-8506-4adf-83f9-b39c196483c4 Sep 21 12:04:58 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:58 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e48b0822-e251-4f4d-843b-5ec1da70897d tempest-VolumesGetTest-1877134668 None] Acquiring lock "cinder-f120cb00-7d7d-4306-9f5e-ae90481d145c-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:04:58 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e48b0822-e251-4f4d-843b-5ec1da70897d tempest-VolumesGetTest-1877134668 None] Lock "cinder-f120cb00-7d7d-4306-9f5e-ae90481d145c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:04:58 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e48b0822-e251-4f4d-843b-5ec1da70897d tempest-VolumesGetTest-1877134668 None] Acquiring lock "cinder-quobyte-f120cb00-7d7d-4306-9f5e-ae90481d145c" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:04:58 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e48b0822-e251-4f4d-843b-5ec1da70897d tempest-VolumesGetTest-1877134668 None] Lock "cinder-quobyte-f120cb00-7d7d-4306-9f5e-ae90481d145c" acquired by "delete_volume" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:04:58 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba29a781-2e3b-4a8a-b60b-b3306fa8b94d]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:04:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e48b0822-e251-4f4d-843b-5ec1da70897d tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f120cb00-7d7d-4306-9f5e-ae90481d145c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:58 devstack sudo[100031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f120cb00-7d7d-4306-9f5e-ae90481d145c Sep 21 12:04:58 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:58 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6c3a6df7-d023-4a8c-9b6e-0c621cea94ab tempest-VolumeDependencyTests-765505224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0063038f-e80b-4aba-9986-b93781a1ccbb -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.b04b26dc-8506-4adf-83f9-b39c196483c4" returned: 0 in 0.430s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:58 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-6c3a6df7-d023-4a8c-9b6e-0c621cea94ab tempest-VolumeDependencyTests-765505224 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.b04b26dc-8506-4adf-83f9-b39c196483c4 is being set with open permissions: ugo+rw Sep 21 12:04:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6c3a6df7-d023-4a8c-9b6e-0c621cea94ab tempest-VolumeDependencyTests-765505224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.b04b26dc-8506-4adf-83f9-b39c196483c4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:58 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.b04b26dc-8506-4adf-83f9-b39c196483c4 Sep 21 12:04:58 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:59 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e48b0822-e251-4f4d-843b-5ec1da70897d tempest-VolumesGetTest-1877134668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f120cb00-7d7d-4306-9f5e-ae90481d145c" returned: 0 in 0.405s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e48b0822-e251-4f4d-843b-5ec1da70897d tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f120cb00-7d7d-4306-9f5e-ae90481d145c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:59 devstack sudo[100043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f120cb00-7d7d-4306-9f5e-ae90481d145c Sep 21 12:04:59 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:59 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6c3a6df7-d023-4a8c-9b6e-0c621cea94ab tempest-VolumeDependencyTests-765505224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.b04b26dc-8506-4adf-83f9-b39c196483c4" returned: 0 in 0.315s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6c3a6df7-d023-4a8c-9b6e-0c621cea94ab tempest-VolumeDependencyTests-765505224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:59 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.info Sep 21 12:04:59 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:59 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e48b0822-e251-4f4d-843b-5ec1da70897d tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f120cb00-7d7d-4306-9f5e-ae90481d145c" returned: 0 in 0.322s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e48b0822-e251-4f4d-843b-5ec1da70897d tempest-VolumesGetTest-1877134668 None] Lock "cinder-quobyte-f120cb00-7d7d-4306-9f5e-ae90481d145c" released by "delete_volume" :: held 0.782s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:04:59 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-e48b0822-e251-4f4d-843b-5ec1da70897d tempest-VolumesGetTest-1877134668 None] Created reservations ['18b48b93-5262-4c18-a086-36436bdc5ce4', '37f973f4-3756-47e6-b2fd-078ee2a11d65', '10813aec-d90c-4641-9501-039fea4e1712', '2c01366f-08d8-47f4-bc0a-ed8641ea218f'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:04:59 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6c3a6df7-d023-4a8c-9b6e-0c621cea94ab tempest-VolumeDependencyTests-765505224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.info" returned: 0 in 0.334s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:59 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-6c3a6df7-d023-4a8c-9b6e-0c621cea94ab tempest-VolumeDependencyTests-765505224 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.info is being set with open permissions: ugo+rw Sep 21 12:04:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6c3a6df7-d023-4a8c-9b6e-0c621cea94ab tempest-VolumeDependencyTests-765505224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:59 devstack sudo[100050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.info Sep 21 12:04:59 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e48b0822-e251-4f4d-843b-5ec1da70897d tempest-VolumesGetTest-1877134668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:04:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e48b0822-e251-4f4d-843b-5ec1da70897d tempest-VolumesGetTest-1877134668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:04:59 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e48b0822-e251-4f4d-843b-5ec1da70897d tempest-VolumesGetTest-1877134668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:04:59 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e48b0822-e251-4f4d-843b-5ec1da70897d tempest-VolumesGetTest-1877134668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:04:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e48b0822-e251-4f4d-843b-5ec1da70897d tempest-VolumesGetTest-1877134668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e48b0822-e251-4f4d-843b-5ec1da70897d tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:59 devstack sudo[100052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:04:59 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:04:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2d970f31-a15c-48ec-ad75-daf1ce4bdaa9 tempest-VolumesGetTest-1877134668 None] Acquiring lock "cinder-716dad07-4823-4b01-8e8e-33d42a0168c0-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:04:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2d970f31-a15c-48ec-ad75-daf1ce4bdaa9 tempest-VolumesGetTest-1877134668 None] Lock "cinder-716dad07-4823-4b01-8e8e-33d42a0168c0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:04:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2d970f31-a15c-48ec-ad75-daf1ce4bdaa9 tempest-VolumesGetTest-1877134668 None] Acquiring lock "cinder-quobyte-716dad07-4823-4b01-8e8e-33d42a0168c0" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:04:59 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6c3a6df7-d023-4a8c-9b6e-0c621cea94ab tempest-VolumeDependencyTests-765505224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.info" returned: 0 in 0.423s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:59 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root Sep 21 12:04:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6c3a6df7-d023-4a8c-9b6e-0c621cea94ab tempest-VolumeDependencyTests-765505224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.607s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:04:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2d970f31-a15c-48ec-ad75-daf1ce4bdaa9 tempest-VolumesGetTest-1877134668 None] Lock "cinder-quobyte-716dad07-4823-4b01-8e8e-33d42a0168c0" acquired by "delete_volume" :: waited 0.051s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:04:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e48b0822-e251-4f4d-843b-5ec1da70897d tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.402s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:04:59 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-e48b0822-e251-4f4d-843b-5ec1da70897d tempest-VolumesGetTest-1877134668 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:04:59 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e6caad-5cf7-4f22-b1a1-20bc224c58fd]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:04:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2d970f31-a15c-48ec-ad75-daf1ce4bdaa9 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-716dad07-4823-4b01-8e8e-33d42a0168c0 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:04:59 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-e48b0822-e251-4f4d-843b-5ec1da70897d tempest-VolumesGetTest-1877134668 None] Deleted volume successfully. Sep 21 12:05:00 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-6c3a6df7-d023-4a8c-9b6e-0c621cea94ab tempest-VolumeDependencyTests-765505224 None] Create snapshot completed successfully Sep 21 12:05:00 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e48b0822-e251-4f4d-843b-5ec1da70897d tempest-VolumesGetTest-1877134668 None] Lock "cinder-f120cb00-7d7d-4306-9f5e-ae90481d145c-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:05:00 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-716dad07-4823-4b01-8e8e-33d42a0168c0 Sep 21 12:05:00 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:00 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2d970f31-a15c-48ec-ad75-daf1ce4bdaa9 tempest-VolumesGetTest-1877134668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-716dad07-4823-4b01-8e8e-33d42a0168c0" returned: 0 in 0.451s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2d970f31-a15c-48ec-ad75-daf1ce4bdaa9 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-716dad07-4823-4b01-8e8e-33d42a0168c0 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:00 devstack sudo[100067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-716dad07-4823-4b01-8e8e-33d42a0168c0 Sep 21 12:05:00 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:00 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2d970f31-a15c-48ec-ad75-daf1ce4bdaa9 tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-716dad07-4823-4b01-8e8e-33d42a0168c0" returned: 0 in 0.264s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:00 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2d970f31-a15c-48ec-ad75-daf1ce4bdaa9 tempest-VolumesGetTest-1877134668 None] Lock "cinder-quobyte-716dad07-4823-4b01-8e8e-33d42a0168c0" released by "delete_volume" :: held 0.775s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:05:00 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-2d970f31-a15c-48ec-ad75-daf1ce4bdaa9 tempest-VolumesGetTest-1877134668 None] Created reservations ['55a0b8b7-0562-4cbf-abe8-a914343eb8e9', '0a013b0f-3e74-44ef-94e7-11404f2a63f5', '07013d77-7aab-476e-9285-7f541031a9fb', 'b8ce4a38-643a-47b3-b9ce-00fe2c98f25c'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:05:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2d970f31-a15c-48ec-ad75-daf1ce4bdaa9 tempest-VolumesGetTest-1877134668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:05:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2d970f31-a15c-48ec-ad75-daf1ce4bdaa9 tempest-VolumesGetTest-1877134668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:05:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2d970f31-a15c-48ec-ad75-daf1ce4bdaa9 tempest-VolumesGetTest-1877134668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:05:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2d970f31-a15c-48ec-ad75-daf1ce4bdaa9 tempest-VolumesGetTest-1877134668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:05:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2d970f31-a15c-48ec-ad75-daf1ce4bdaa9 tempest-VolumesGetTest-1877134668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:05:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2d970f31-a15c-48ec-ad75-daf1ce4bdaa9 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:00 devstack sudo[100070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:05:00 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:01 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2d970f31-a15c-48ec-ad75-daf1ce4bdaa9 tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.308s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-2d970f31-a15c-48ec-ad75-daf1ce4bdaa9 tempest-VolumesGetTest-1877134668 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:05:01 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-2d970f31-a15c-48ec-ad75-daf1ce4bdaa9 tempest-VolumesGetTest-1877134668 None] Deleted volume successfully. Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2d970f31-a15c-48ec-ad75-daf1ce4bdaa9 tempest-VolumesGetTest-1877134668 None] Lock "cinder-716dad07-4823-4b01-8e8e-33d42a0168c0-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Flow 'volume_create_manager' (1df70d8a-7ef1-4c9c-b536-1ce00bda6301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8976925-adbd-40f7-a964-a29003a495d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Flow 'volume_create_manager' (36dc4206-2943-4238-afaa-8e0a4b08d64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c15d82f-8832-4f75-aa56-be486e89172f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8976925-adbd-40f7-a964-a29003a495d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-23451717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1efb8e04-51da-4e10-8b5a-85f068321396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c183949a75984aad9712c44ddd7f291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:05:02Z,use_quota=True,user_id='a477515563f342dea8931e50cf28fbc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4fecd25-fefd-46ea-9333-bcd2c20c0b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4fecd25-fefd-46ea-9333-bcd2c20c0b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98aadcec-bbfc-45be-805f-1eb63ee0b98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98aadcec-bbfc-45be-805f-1eb63ee0b98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1efb8e04-51da-4e10-8b5a-85f068321396', 'volume_name': 'volume-1efb8e04-51da-4e10-8b5a-85f068321396', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e8e8f28-9e1c-4e33-a56b-36eb780e40c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e8e8f28-9e1c-4e33-a56b-36eb780e40c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e63f29-6c1b-42c1-989a-8a966d6d4172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:01 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Volume 1efb8e04-51da-4e10-8b5a-85f068321396: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1efb8e04-51da-4e10-8b5a-85f068321396', 'volume_size': 1} Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-23451717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1efb8e04-51da-4e10-8b5a-85f068321396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c183949a75984aad9712c44ddd7f291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:05:02Z,use_quota=True,user_id='a477515563f342dea8931e50cf28fbc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Creating volume 1efb8e04-51da-4e10-8b5a-85f068321396 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:05:01 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:01 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396 1073741824 Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c15d82f-8832-4f75-aa56-be486e89172f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-262025038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1305ad7c-b02b-4946-9a3f-82ffedbbbaae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c354847598542b28ec16db9496a29b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b04b26dc-8506-4adf-83f9-b39c196483c4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:05:02Z,use_quota=True,user_id='74d4d5ae356e437a97c5255a72db5920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:01 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab33aff1-89e5-4c0a-b0e1-a4ac9f96f55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab33aff1-89e5-4c0a-b0e1-a4ac9f96f55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0611b753-aba2-4082-991b-71094e2ca522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0611b753-aba2-4082-991b-71094e2ca522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1305ad7c-b02b-4946-9a3f-82ffedbbbaae', 'volume_name': 'volume-1305ad7c-b02b-4946-9a3f-82ffedbbbaae', 'volume_size': 1, 'snapshot_id': 'b04b26dc-8506-4adf-83f9-b39c196483c4'}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e84289-af00-4321-ae1b-245554850c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e84289-af00-4321-ae1b-245554850c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (794dbf54-7df9-4a26-86dc-23802c4a0f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:02 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Volume 1305ad7c-b02b-4946-9a3f-82ffedbbbaae: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1305ad7c-b02b-4946-9a3f-82ffedbbbaae', 'volume_size': 1, 'snapshot_id': 'b04b26dc-8506-4adf-83f9-b39c196483c4'} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:05:02 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396 1073741824" returned: 0 in 0.581s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:02 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396 Sep 21 12:05:02 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:02 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396" returned: 0 in 0.263s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.813s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Acquiring lock "cinder-quobyte-b04b26dc-8506-4adf-83f9-b39c196483c4-1305ad7c-b02b-4946-9a3f-82ffedbbbaae" by "_create_volume_from_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e63f29-6c1b-42c1-989a-8a966d6d4172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1efb8e04-51da-4e10-8b5a-85f068321396', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7540cfeb-75d2-4913-b7f6-3397c6db1307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Lock "cinder-quobyte-b04b26dc-8506-4adf-83f9-b39c196483c4-1305ad7c-b02b-4946-9a3f-82ffedbbbaae" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Creating volume 1305ad7c-b02b-4946-9a3f-82ffedbbbaae from snapshot b04b26dc-8506-4adf-83f9-b39c196483c4 {{(pid=86366) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Acquiring lock "cinder-quobyte-1305ad7c-b02b-4946-9a3f-82ffedbbbaae" by "_copy_volume_from_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:05:02 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Volume volume-1efb8e04-51da-4e10-8b5a-85f068321396 (1efb8e04-51da-4e10-8b5a-85f068321396): created successfully Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7540cfeb-75d2-4913-b7f6-3397c6db1307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Flow 'volume_create_manager' (1df70d8a-7ef1-4c9c-b536-1ce00bda6301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Lock "cinder-quobyte-1305ad7c-b02b-4946-9a3f-82ffedbbbaae" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] snapshot: b04b26dc-8506-4adf-83f9-b39c196483c4, volume: 1305ad7c-b02b-4946-9a3f-82ffedbbbaae, {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 21 12:05:02 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-ab8013be-5f83-4a72-b183-f746d7411e87 tempest-VolumesGetTest-1877134668 None] Created volume successfully. Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[7206bb55-9394-47f3-99b0-f9faba243342]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:05:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.b04b26dc-8506-4adf-83f9-b39c196483c4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:03 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.b04b26dc-8506-4adf-83f9-b39c196483c4 Sep 21 12:05:03 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:03 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.b04b26dc-8506-4adf-83f9-b39c196483c4" returned: 0 in 0.424s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0063038f-e80b-4aba-9986-b93781a1ccbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:05:03 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[65703a41-fe7d-47d6-b605-81e5c0805c9e]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:05:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:03 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb Sep 21 12:05:03 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:03 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 12:05:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:05:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:05:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:05:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:05:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:05:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:03 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:05:03 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:04 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb" returned: 0 in 0.580s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 21 12:05:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Creating direct copy from snapshot {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 21 12:05:04 devstack cinder-volume[86366]: DEBUG cinder.utils [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Path /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1305ad7c-b02b-4946-9a3f-82ffedbbbaae not found in is_blk_device check {{(pid=86366) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 21 12:05:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1305ad7c-b02b-4946-9a3f-82ffedbbbaae {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:04 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1305ad7c-b02b-4946-9a3f-82ffedbbbaae Sep 21 12:05:04 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:04 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.440s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:04 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:05:04 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 12:05:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread count: 28 {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 12:05:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread info: [<_MainThread(MainThread, started 132841976594560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 12:05:04 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:05:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Flow 'volume_create_manager' (0b3d3a22-18a9-4bd5-9535-b1af592b17eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:05:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a0d907-7af8-439e-9c98-d52454038549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a0d907-7af8-439e-9c98-d52454038549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1364917353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1fd2a25-fd53-4341-9040-58ff52090a35,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c183949a75984aad9712c44ddd7f291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=1efb8e04-51da-4e10-8b5a-85f068321396,status='creating',terminated_at=None,updated_at=2026-09-21T10:05:04Z,use_quota=True,user_id='a477515563f342dea8931e50cf28fbc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (956d2725-6b1d-4941-a00f-9865f77153b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (956d2725-6b1d-4941-a00f-9865f77153b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2516765e-db49-4884-81d2-31f56c3a543d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2516765e-db49-4884-81d2-31f56c3a543d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b1fd2a25-fd53-4341-9040-58ff52090a35', 'volume_name': 'volume-b1fd2a25-fd53-4341-9040-58ff52090a35', 'volume_size': 1, 'source_volid': '1efb8e04-51da-4e10-8b5a-85f068321396', 'source_volstatus': 'available'}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73e49e8a-1e76-4a02-9675-5f80f30949ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73e49e8a-1e76-4a02-9675-5f80f30949ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9fe6a66-8d1d-4643-8c3e-4116a3fcb9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:04 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Volume b1fd2a25-fd53-4341-9040-58ff52090a35: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b1fd2a25-fd53-4341-9040-58ff52090a35', 'volume_size': 1, 'source_volid': '1efb8e04-51da-4e10-8b5a-85f068321396', 'source_volstatus': 'available'} Sep 21 12:05:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:05:08 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:05:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Flow 'volume_create_manager' (03df6d2f-3193-49b7-b8d2-938eb81fb56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:05:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2935fe5b-dfe0-4925-b8d7-63c3e450b78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2935fe5b-dfe0-4925-b8d7-63c3e450b78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-451617454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7fdffa4-ef8e-400d-8119-61f0450a0abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05e44de52eba4775bf840b8bec9d69d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:05:08Z,use_quota=True,user_id='15f2af23a6a348a1acbc3bab3b607ccf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a4ff65-f71e-4f6e-95c5-8123b9eef6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6a4ff65-f71e-4f6e-95c5-8123b9eef6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a77e7cf-da68-43af-8a7c-7451f33e696e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a77e7cf-da68-43af-8a7c-7451f33e696e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7fdffa4-ef8e-400d-8119-61f0450a0abf', 'volume_name': 'volume-d7fdffa4-ef8e-400d-8119-61f0450a0abf', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e903e7f4-1298-4e1d-afcb-d1599534d29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e903e7f4-1298-4e1d-afcb-d1599534d29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f884d72-5470-42cf-9f43-4ed2285e2dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:08 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Volume d7fdffa4-ef8e-400d-8119-61f0450a0abf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7fdffa4-ef8e-400d-8119-61f0450a0abf', 'volume_size': 1} Sep 21 12:05:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:05:11 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1305ad7c-b02b-4946-9a3f-82ffedbbbaae" returned: 0 in 7.840s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:11 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Image conversion details: src /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb, size 1024.00 MB, duration 7.84 sec, destination /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1305ad7c-b02b-4946-9a3f-82ffedbbbaae {{(pid=86366) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 12:05:11 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Converted 1024.00 MB image at 130.59 MB/s Sep 21 12:05:11 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1305ad7c-b02b-4946-9a3f-82ffedbbbaae is being set with open permissions: ugo+rw Sep 21 12:05:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1305ad7c-b02b-4946-9a3f-82ffedbbbaae {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:11 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1305ad7c-b02b-4946-9a3f-82ffedbbbaae Sep 21 12:05:11 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:12 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1305ad7c-b02b-4946-9a3f-82ffedbbbaae" returned: 0 in 0.265s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Lock "cinder-quobyte-1305ad7c-b02b-4946-9a3f-82ffedbbbaae" released by "_copy_volume_from_snapshot" :: held 9.228s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:05:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Lock "cinder-quobyte-b04b26dc-8506-4adf-83f9-b39c196483c4-1305ad7c-b02b-4946-9a3f-82ffedbbbaae" released by "_create_volume_from_snapshot" :: held 9.300s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:05:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.334s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:05:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 7.653s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:05:12 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Cloning volume 1efb8e04-51da-4e10-8b5a-85f068321396 to volume b1fd2a25-fd53-4341-9040-58ff52090a35 Sep 21 12:05:12 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (794dbf54-7df9-4a26-86dc-23802c4a0f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1305ad7c-b02b-4946-9a3f-82ffedbbbaae', 'volume_size': 1, 'snapshot_id': 'b04b26dc-8506-4adf-83f9-b39c196483c4'}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:12 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (231d4856-d4f0-4e58-9a6f-2f5da9e04d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:12 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Volume volume-1305ad7c-b02b-4946-9a3f-82ffedbbbaae (1305ad7c-b02b-4946-9a3f-82ffedbbbaae): created successfully Sep 21 12:05:12 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (231d4856-d4f0-4e58-9a6f-2f5da9e04d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:12 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Flow 'volume_create_manager' (36dc4206-2943-4238-afaa-8e0a4b08d64c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:05:12 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Creating offline snapshot c59c66c9-10bb-4a1f-b816-fbfa816a24cf of volume 1efb8e04-51da-4e10-8b5a-85f068321396 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:05:12 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-fcc5f353-6220-49d9-915f-ac72e38d489a tempest-VolumeDependencyTests-765505224 None] Created volume successfully. Sep 21 12:05:12 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b8b5f3-e466-48f9-8672-0156db223490]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:05:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:12 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396 Sep 21 12:05:12 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:12 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396" returned: 0 in 0.435s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.c59c66c9-10bb-4a1f-b816-fbfa816a24cf 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5703102e-b509-4e83-8d3c-b6afdb0265cd tempest-VolumeDependencyTests-765505224 None] Acquiring lock "cinder-b04b26dc-8506-4adf-83f9-b39c196483c4-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:05:12 devstack sudo[100129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.c59c66c9-10bb-4a1f-b816-fbfa816a24cf 1G Sep 21 12:05:12 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5703102e-b509-4e83-8d3c-b6afdb0265cd tempest-VolumeDependencyTests-765505224 None] Lock "cinder-b04b26dc-8506-4adf-83f9-b39c196483c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:05:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5703102e-b509-4e83-8d3c-b6afdb0265cd tempest-VolumeDependencyTests-765505224 None] Acquiring lock "cinder-quobyte-0063038f-e80b-4aba-9986-b93781a1ccbb" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:05:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5703102e-b509-4e83-8d3c-b6afdb0265cd tempest-VolumeDependencyTests-765505224 None] Lock "cinder-quobyte-0063038f-e80b-4aba-9986-b93781a1ccbb" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:05:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5703102e-b509-4e83-8d3c-b6afdb0265cd tempest-VolumeDependencyTests-765505224 None] Acquiring lock "cinder-quobyte-b04b26dc-8506-4adf-83f9-b39c196483c4" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:05:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5703102e-b509-4e83-8d3c-b6afdb0265cd tempest-VolumeDependencyTests-765505224 None] Lock "cinder-quobyte-b04b26dc-8506-4adf-83f9-b39c196483c4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:05:12 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-5703102e-b509-4e83-8d3c-b6afdb0265cd tempest-VolumeDependencyTests-765505224 None] Deleting offline snapshot b04b26dc-8506-4adf-83f9-b39c196483c4 of volume 0063038f-e80b-4aba-9986-b93781a1ccbb {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:05:12 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-5703102e-b509-4e83-8d3c-b6afdb0265cd tempest-VolumeDependencyTests-765505224 None] snapshot_file for this snap is: volume-0063038f-e80b-4aba-9986-b93781a1ccbb.b04b26dc-8506-4adf-83f9-b39c196483c4 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:05:12 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2d6948-b7cf-4b66-ae97-9d7b2c56e409]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:05:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5703102e-b509-4e83-8d3c-b6afdb0265cd tempest-VolumeDependencyTests-765505224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.b04b26dc-8506-4adf-83f9-b39c196483c4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:12 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.b04b26dc-8506-4adf-83f9-b39c196483c4 Sep 21 12:05:12 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:13 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.c59c66c9-10bb-4a1f-b816-fbfa816a24cf 1G" returned: 0 in 0.497s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1efb8e04-51da-4e10-8b5a-85f068321396 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.c59c66c9-10bb-4a1f-b816-fbfa816a24cf {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:13 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1efb8e04-51da-4e10-8b5a-85f068321396 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.c59c66c9-10bb-4a1f-b816-fbfa816a24cf Sep 21 12:05:13 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:13 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5703102e-b509-4e83-8d3c-b6afdb0265cd tempest-VolumeDependencyTests-765505224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.b04b26dc-8506-4adf-83f9-b39c196483c4" returned: 0 in 0.428s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:13 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-5703102e-b509-4e83-8d3c-b6afdb0265cd tempest-VolumeDependencyTests-765505224 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0063038f-e80b-4aba-9986-b93781a1ccbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:05:13 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddfb7b1-7a3d-48bc-a544-09ca86bc23bd]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:05:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5703102e-b509-4e83-8d3c-b6afdb0265cd tempest-VolumeDependencyTests-765505224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:13 devstack sudo[100141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb Sep 21 12:05:13 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:13 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1efb8e04-51da-4e10-8b5a-85f068321396 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.c59c66c9-10bb-4a1f-b816-fbfa816a24cf" returned: 0 in 0.350s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:13 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.c59c66c9-10bb-4a1f-b816-fbfa816a24cf is being set with open permissions: ugo+rw Sep 21 12:05:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.c59c66c9-10bb-4a1f-b816-fbfa816a24cf {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:13 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.c59c66c9-10bb-4a1f-b816-fbfa816a24cf Sep 21 12:05:13 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:13 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.c59c66c9-10bb-4a1f-b816-fbfa816a24cf" returned: 0 in 0.264s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:13 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.info Sep 21 12:05:13 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:13 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5703102e-b509-4e83-8d3c-b6afdb0265cd tempest-VolumeDependencyTests-765505224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb" returned: 0 in 0.615s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5703102e-b509-4e83-8d3c-b6afdb0265cd tempest-VolumeDependencyTests-765505224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.b04b26dc-8506-4adf-83f9-b39c196483c4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:13 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.b04b26dc-8506-4adf-83f9-b39c196483c4 Sep 21 12:05:13 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:14 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.info" returned: 0 in 0.276s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:14 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.info is being set with open permissions: ugo+rw Sep 21 12:05:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:14 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.info Sep 21 12:05:14 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:14 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5703102e-b509-4e83-8d3c-b6afdb0265cd tempest-VolumeDependencyTests-765505224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.b04b26dc-8506-4adf-83f9-b39c196483c4" returned: 0 in 0.412s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5703102e-b509-4e83-8d3c-b6afdb0265cd tempest-VolumeDependencyTests-765505224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.b04b26dc-8506-4adf-83f9-b39c196483c4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:14 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.b04b26dc-8506-4adf-83f9-b39c196483c4 Sep 21 12:05:14 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:14 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.info" returned: 0 in 0.294s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Acquiring lock "cinder-quobyte-b1fd2a25-fd53-4341-9040-58ff52090a35" by "_copy_volume_from_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:05:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Lock "cinder-quobyte-b1fd2a25-fd53-4341-9040-58ff52090a35" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:05:14 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] snapshot: c59c66c9-10bb-4a1f-b816-fbfa816a24cf, volume: b1fd2a25-fd53-4341-9040-58ff52090a35, {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 21 12:05:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:05:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:05:14 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:05:14 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:05:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:05:14 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a25037-29f0-4a17-9e88-c35cebb93619]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:05:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.c59c66c9-10bb-4a1f-b816-fbfa816a24cf {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:14 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5703102e-b509-4e83-8d3c-b6afdb0265cd tempest-VolumeDependencyTests-765505224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb.b04b26dc-8506-4adf-83f9-b39c196483c4" returned: 0 in 0.310s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:14 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.c59c66c9-10bb-4a1f-b816-fbfa816a24cf Sep 21 12:05:14 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5703102e-b509-4e83-8d3c-b6afdb0265cd tempest-VolumeDependencyTests-765505224 None] Lock "cinder-quobyte-b04b26dc-8506-4adf-83f9-b39c196483c4" released by "_delete_snapshot" :: held 1.897s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:05:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5703102e-b509-4e83-8d3c-b6afdb0265cd tempest-VolumeDependencyTests-765505224 None] Lock "cinder-quobyte-0063038f-e80b-4aba-9986-b93781a1ccbb" released by "delete_snapshot" :: held 1.927s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:05:14 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-5703102e-b509-4e83-8d3c-b6afdb0265cd tempest-VolumeDependencyTests-765505224 None] Created reservations ['34526e19-6092-40f5-b402-af15245aaa98', 'c536f46e-b6c5-4d52-84ad-327146120c5e', 'b51c2392-758d-4f6f-b8d2-bcdc2f8ffae2', 'c560e6f7-7924-464e-adb5-2fd5a7c10330'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:05:14 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-5703102e-b509-4e83-8d3c-b6afdb0265cd tempest-VolumeDependencyTests-765505224 None] Delete snapshot completed successfully. Sep 21 12:05:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5703102e-b509-4e83-8d3c-b6afdb0265cd tempest-VolumeDependencyTests-765505224 None] Lock "cinder-b04b26dc-8506-4adf-83f9-b39c196483c4-delete_snapshot" released by "delete_snapshot" :: held 2.156s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:05:15 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.c59c66c9-10bb-4a1f-b816-fbfa816a24cf" returned: 0 in 0.507s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:15 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1efb8e04-51da-4e10-8b5a-85f068321396(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:05:15 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[33447370-a97f-47d9-8b31-2d82f894a177]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:05:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:15 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396 Sep 21 12:05:15 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:15 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396" returned: 0 in 0.503s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:15 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396 {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 21 12:05:15 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Creating direct copy from snapshot {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 21 12:05:15 devstack cinder-volume[86366]: DEBUG cinder.utils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Path /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b1fd2a25-fd53-4341-9040-58ff52090a35 not found in is_blk_device check {{(pid=86366) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 21 12:05:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b1fd2a25-fd53-4341-9040-58ff52090a35 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:15 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b1fd2a25-fd53-4341-9040-58ff52090a35 Sep 21 12:05:15 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:16 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1bd255fc-1739-4a43-b591-4276c71403b6 tempest-VolumeDependencyTests-765505224 None] Acquiring lock "cinder-0063038f-e80b-4aba-9986-b93781a1ccbb-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:05:16 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1bd255fc-1739-4a43-b591-4276c71403b6 tempest-VolumeDependencyTests-765505224 None] Lock "cinder-0063038f-e80b-4aba-9986-b93781a1ccbb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:05:16 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1bd255fc-1739-4a43-b591-4276c71403b6 tempest-VolumeDependencyTests-765505224 None] Acquiring lock "cinder-quobyte-0063038f-e80b-4aba-9986-b93781a1ccbb" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:05:16 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1bd255fc-1739-4a43-b591-4276c71403b6 tempest-VolumeDependencyTests-765505224 None] Lock "cinder-quobyte-0063038f-e80b-4aba-9986-b93781a1ccbb" acquired by "delete_volume" :: waited 0.026s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:05:16 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b4729f-44d6-439a-bd9c-fa534c378796]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:05:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1bd255fc-1739-4a43-b591-4276c71403b6 tempest-VolumeDependencyTests-765505224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:16 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb Sep 21 12:05:16 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:16 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1bd255fc-1739-4a43-b591-4276c71403b6 tempest-VolumeDependencyTests-765505224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb" returned: 0 in 0.814s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1bd255fc-1739-4a43-b591-4276c71403b6 tempest-VolumeDependencyTests-765505224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:17 devstack sudo[100194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb Sep 21 12:05:17 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:17 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1bd255fc-1739-4a43-b591-4276c71403b6 tempest-VolumeDependencyTests-765505224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0063038f-e80b-4aba-9986-b93781a1ccbb" returned: 0 in 0.643s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1bd255fc-1739-4a43-b591-4276c71403b6 tempest-VolumeDependencyTests-765505224 None] Lock "cinder-quobyte-0063038f-e80b-4aba-9986-b93781a1ccbb" released by "delete_volume" :: held 1.542s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:05:17 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-1bd255fc-1739-4a43-b591-4276c71403b6 tempest-VolumeDependencyTests-765505224 None] Created reservations ['020235a4-c2ec-4069-b953-8fa5ae46a70b', 'c0d485e5-5f83-412d-bb2e-455f9fa3b3de', '638c1b97-734a-42b3-8946-8236e0268677', '1da73144-a29c-4931-b816-24c0b64e509c'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:05:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1bd255fc-1739-4a43-b591-4276c71403b6 tempest-VolumeDependencyTests-765505224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:05:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1bd255fc-1739-4a43-b591-4276c71403b6 tempest-VolumeDependencyTests-765505224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:05:17 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1bd255fc-1739-4a43-b591-4276c71403b6 tempest-VolumeDependencyTests-765505224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:05:17 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1bd255fc-1739-4a43-b591-4276c71403b6 tempest-VolumeDependencyTests-765505224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:05:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1bd255fc-1739-4a43-b591-4276c71403b6 tempest-VolumeDependencyTests-765505224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:05:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1bd255fc-1739-4a43-b591-4276c71403b6 tempest-VolumeDependencyTests-765505224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:18 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:05:18 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:18 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1bd255fc-1739-4a43-b591-4276c71403b6 tempest-VolumeDependencyTests-765505224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.410s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:18 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-1bd255fc-1739-4a43-b591-4276c71403b6 tempest-VolumeDependencyTests-765505224 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:05:18 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1bd255fc-1739-4a43-b591-4276c71403b6 tempest-VolumeDependencyTests-765505224 None] Deleted volume successfully. Sep 21 12:05:18 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1bd255fc-1739-4a43-b591-4276c71403b6 tempest-VolumeDependencyTests-765505224 None] Lock "cinder-0063038f-e80b-4aba-9986-b93781a1ccbb-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:05:18 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-579aabf2-01b2-4f70-a0de-cc301fbd53b7 tempest-VolumeDependencyTests-765505224 None] Acquiring lock "cinder-1305ad7c-b02b-4946-9a3f-82ffedbbbaae-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:05:18 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-579aabf2-01b2-4f70-a0de-cc301fbd53b7 tempest-VolumeDependencyTests-765505224 None] Lock "cinder-1305ad7c-b02b-4946-9a3f-82ffedbbbaae-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:05:18 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-579aabf2-01b2-4f70-a0de-cc301fbd53b7 tempest-VolumeDependencyTests-765505224 None] Acquiring lock "cinder-quobyte-1305ad7c-b02b-4946-9a3f-82ffedbbbaae" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:05:18 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-579aabf2-01b2-4f70-a0de-cc301fbd53b7 tempest-VolumeDependencyTests-765505224 None] Lock "cinder-quobyte-1305ad7c-b02b-4946-9a3f-82ffedbbbaae" acquired by "delete_volume" :: waited 0.041s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:05:18 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad505bc-2082-431a-a67e-2eee900f92e5]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:05:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-579aabf2-01b2-4f70-a0de-cc301fbd53b7 tempest-VolumeDependencyTests-765505224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1305ad7c-b02b-4946-9a3f-82ffedbbbaae {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:19 devstack sudo[100201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1305ad7c-b02b-4946-9a3f-82ffedbbbaae Sep 21 12:05:19 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:19 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-579aabf2-01b2-4f70-a0de-cc301fbd53b7 tempest-VolumeDependencyTests-765505224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1305ad7c-b02b-4946-9a3f-82ffedbbbaae" returned: 0 in 0.904s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-579aabf2-01b2-4f70-a0de-cc301fbd53b7 tempest-VolumeDependencyTests-765505224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1305ad7c-b02b-4946-9a3f-82ffedbbbaae {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:19 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1305ad7c-b02b-4946-9a3f-82ffedbbbaae Sep 21 12:05:19 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:20 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-579aabf2-01b2-4f70-a0de-cc301fbd53b7 tempest-VolumeDependencyTests-765505224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1305ad7c-b02b-4946-9a3f-82ffedbbbaae" returned: 0 in 0.497s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:20 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-579aabf2-01b2-4f70-a0de-cc301fbd53b7 tempest-VolumeDependencyTests-765505224 None] Lock "cinder-quobyte-1305ad7c-b02b-4946-9a3f-82ffedbbbaae" released by "delete_volume" :: held 1.534s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:05:20 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-579aabf2-01b2-4f70-a0de-cc301fbd53b7 tempest-VolumeDependencyTests-765505224 None] Created reservations ['80322d47-e801-4f0c-b355-8a30782998da', '24e4fdb1-cf69-4d94-9000-87c012334352', 'db823708-dc62-42e7-9d7e-cd7e948c4dfe', 'a0ea2868-4e9e-4bc1-826b-2073f78d584b'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:05:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-579aabf2-01b2-4f70-a0de-cc301fbd53b7 tempest-VolumeDependencyTests-765505224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:05:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-579aabf2-01b2-4f70-a0de-cc301fbd53b7 tempest-VolumeDependencyTests-765505224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:05:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-579aabf2-01b2-4f70-a0de-cc301fbd53b7 tempest-VolumeDependencyTests-765505224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:05:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-579aabf2-01b2-4f70-a0de-cc301fbd53b7 tempest-VolumeDependencyTests-765505224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:05:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-579aabf2-01b2-4f70-a0de-cc301fbd53b7 tempest-VolumeDependencyTests-765505224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:05:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-579aabf2-01b2-4f70-a0de-cc301fbd53b7 tempest-VolumeDependencyTests-765505224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:20 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:05:20 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:21 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-579aabf2-01b2-4f70-a0de-cc301fbd53b7 tempest-VolumeDependencyTests-765505224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.585s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:21 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-579aabf2-01b2-4f70-a0de-cc301fbd53b7 tempest-VolumeDependencyTests-765505224 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:05:21 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-579aabf2-01b2-4f70-a0de-cc301fbd53b7 tempest-VolumeDependencyTests-765505224 None] Deleted volume successfully. Sep 21 12:05:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-579aabf2-01b2-4f70-a0de-cc301fbd53b7 tempest-VolumeDependencyTests-765505224 None] Lock "cinder-1305ad7c-b02b-4946-9a3f-82ffedbbbaae-delete_volume" released by "delete_volume" :: held 2.708s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:05:24 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b1fd2a25-fd53-4341-9040-58ff52090a35" returned: 0 in 8.934s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:24 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Image conversion details: src /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396, size 1024.00 MB, duration 8.94 sec, destination /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b1fd2a25-fd53-4341-9040-58ff52090a35 {{(pid=86366) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 12:05:24 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Converted 1024.00 MB image at 114.60 MB/s Sep 21 12:05:24 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b1fd2a25-fd53-4341-9040-58ff52090a35 is being set with open permissions: ugo+rw Sep 21 12:05:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b1fd2a25-fd53-4341-9040-58ff52090a35 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:24 devstack sudo[100213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b1fd2a25-fd53-4341-9040-58ff52090a35 Sep 21 12:05:24 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:24 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b1fd2a25-fd53-4341-9040-58ff52090a35" returned: 0 in 0.313s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:24 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Lock "cinder-quobyte-b1fd2a25-fd53-4341-9040-58ff52090a35" released by "_copy_volume_from_snapshot" :: held 10.374s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:05:24 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Acquiring lock "cinder-quobyte-c59c66c9-10bb-4a1f-b816-fbfa816a24cf" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:05:24 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Lock "cinder-quobyte-c59c66c9-10bb-4a1f-b816-fbfa816a24cf" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:05:24 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Deleting offline snapshot c59c66c9-10bb-4a1f-b816-fbfa816a24cf of volume 1efb8e04-51da-4e10-8b5a-85f068321396 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:05:24 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] snapshot_file for this snap is: volume-1efb8e04-51da-4e10-8b5a-85f068321396.c59c66c9-10bb-4a1f-b816-fbfa816a24cf {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:05:24 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[68850259-add3-4027-82ce-899124f3d2f3]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:05:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.c59c66c9-10bb-4a1f-b816-fbfa816a24cf {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:25 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.c59c66c9-10bb-4a1f-b816-fbfa816a24cf Sep 21 12:05:25 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:25 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.c59c66c9-10bb-4a1f-b816-fbfa816a24cf" returned: 0 in 0.515s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:25 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1efb8e04-51da-4e10-8b5a-85f068321396(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:05:25 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[7911adba-6a9d-48c9-9803-dfef8ed1f340]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:05:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:25 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396 Sep 21 12:05:25 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:26 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396" returned: 0 in 0.743s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.c59c66c9-10bb-4a1f-b816-fbfa816a24cf {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:26 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.c59c66c9-10bb-4a1f-b816-fbfa816a24cf Sep 21 12:05:26 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:26 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.c59c66c9-10bb-4a1f-b816-fbfa816a24cf" returned: 0 in 0.625s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.c59c66c9-10bb-4a1f-b816-fbfa816a24cf {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:26 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.c59c66c9-10bb-4a1f-b816-fbfa816a24cf Sep 21 12:05:26 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:27 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396.c59c66c9-10bb-4a1f-b816-fbfa816a24cf" returned: 0 in 0.431s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:27 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Lock "cinder-quobyte-c59c66c9-10bb-4a1f-b816-fbfa816a24cf" released by "_delete_snapshot" :: held 2.525s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:05:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.355s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:05:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.360s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:05:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-451617454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7fdffa4-ef8e-400d-8119-61f0450a0abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05e44de52eba4775bf840b8bec9d69d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:05:08Z,use_quota=True,user_id='15f2af23a6a348a1acbc3bab3b607ccf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:05:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Creating volume d7fdffa4-ef8e-400d-8119-61f0450a0abf {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:05:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:05:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:05:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:05:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:05:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:05:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:05:27 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:05:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d7fdffa4-ef8e-400d-8119-61f0450a0abf 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9fe6a66-8d1d-4643-8c3e-4116a3fcb9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1fd2a25-fd53-4341-9040-58ff52090a35', 'volume_size': 1, 'source_volid': '1efb8e04-51da-4e10-8b5a-85f068321396', 'source_volstatus': 'available'}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (976f3d08-9641-42b9-a97d-2ac02d895ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:27 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d7fdffa4-ef8e-400d-8119-61f0450a0abf 1073741824 Sep 21 12:05:27 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:27 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Volume volume-b1fd2a25-fd53-4341-9040-58ff52090a35 (b1fd2a25-fd53-4341-9040-58ff52090a35): created successfully Sep 21 12:05:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (976f3d08-9641-42b9-a97d-2ac02d895ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Flow 'volume_create_manager' (0b3d3a22-18a9-4bd5-9535-b1af592b17eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:05:27 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-5f3e485f-d6fa-4f1f-885b-69b7362ab713 tempest-VolumesGetTest-1877134668 None] Created volume successfully. Sep 21 12:05:28 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d7fdffa4-ef8e-400d-8119-61f0450a0abf 1073741824" returned: 0 in 0.712s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d7fdffa4-ef8e-400d-8119-61f0450a0abf {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:28 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d7fdffa4-ef8e-400d-8119-61f0450a0abf Sep 21 12:05:28 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:28 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d7fdffa4-ef8e-400d-8119-61f0450a0abf" returned: 0 in 0.353s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:28 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:05:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:05:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f884d72-5470-42cf-9f43-4ed2285e2dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7fdffa4-ef8e-400d-8119-61f0450a0abf', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0600e845-bad5-4f0b-95e4-1467d9f08d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:28 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Volume volume-d7fdffa4-ef8e-400d-8119-61f0450a0abf (d7fdffa4-ef8e-400d-8119-61f0450a0abf): created successfully Sep 21 12:05:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0600e845-bad5-4f0b-95e4-1467d9f08d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Flow 'volume_create_manager' (03df6d2f-3193-49b7-b8d2-938eb81fb56a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:05:28 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-babbb5b1-475d-4fd5-b02c-b9ed271d5ce0 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Created volume successfully. Sep 21 12:05:29 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:05:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Flow 'volume_create_manager' (976e8953-15bb-4879-9da1-bac569aab23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:05:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5a29a8-6fbc-4909-8d27-f2d48b38248a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5a29a8-6fbc-4909-8d27-f2d48b38248a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:05:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-545556739',display_name='tempest-VolumesGetTest-Volume-1589400616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33883402-4860-4fbc-a8ee-ea909444783d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c183949a75984aad9712c44ddd7f291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:05:30Z,use_quota=True,user_id='a477515563f342dea8931e50cf28fbc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7895ee13-25f9-41e8-8300-e04c9bf193af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7895ee13-25f9-41e8-8300-e04c9bf193af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fde8599-7f82-4f69-afa2-5c8672e1607c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fde8599-7f82-4f69-afa2-5c8672e1607c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33883402-4860-4fbc-a8ee-ea909444783d', 'volume_name': 'volume-33883402-4860-4fbc-a8ee-ea909444783d', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce78cbc6-97e3-4472-8b0f-4e8faf918764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce78cbc6-97e3-4472-8b0f-4e8faf918764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45142c02-a5ea-4811-bba1-f6c898d2d415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:29 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Volume 33883402-4860-4fbc-a8ee-ea909444783d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33883402-4860-4fbc-a8ee-ea909444783d', 'volume_size': 1} Sep 21 12:05:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:05:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:05:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:05:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-545556739',display_name='tempest-VolumesGetTest-Volume-1589400616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33883402-4860-4fbc-a8ee-ea909444783d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c183949a75984aad9712c44ddd7f291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:05:30Z,use_quota=True,user_id='a477515563f342dea8931e50cf28fbc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:05:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Creating volume 33883402-4860-4fbc-a8ee-ea909444783d {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:05:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:05:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:05:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:05:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:05:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:05:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:05:29 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:05:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-33883402-4860-4fbc-a8ee-ea909444783d 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:29 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-33883402-4860-4fbc-a8ee-ea909444783d 1073741824 Sep 21 12:05:29 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:30 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-33883402-4860-4fbc-a8ee-ea909444783d 1073741824" returned: 0 in 0.719s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-33883402-4860-4fbc-a8ee-ea909444783d {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:30 devstack sudo[100257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-33883402-4860-4fbc-a8ee-ea909444783d Sep 21 12:05:30 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:31 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-33883402-4860-4fbc-a8ee-ea909444783d" returned: 0 in 0.353s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:05:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:05:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45142c02-a5ea-4811-bba1-f6c898d2d415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33883402-4860-4fbc-a8ee-ea909444783d', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (723f3b66-1bc7-43f5-aae3-88aa57506f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-495cab18-6140-4d74-a9c5-135492a5cb55 req-6b5f08bf-3093-4116-9fa5-bb687dd7b9eb tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:05:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-495cab18-6140-4d74-a9c5-135492a5cb55 req-6b5f08bf-3093-4116-9fa5-bb687dd7b9eb tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:05:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-495cab18-6140-4d74-a9c5-135492a5cb55 req-6b5f08bf-3093-4116-9fa5-bb687dd7b9eb tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:05:31 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Volume volume-33883402-4860-4fbc-a8ee-ea909444783d (33883402-4860-4fbc-a8ee-ea909444783d): created successfully Sep 21 12:05:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (723f3b66-1bc7-43f5-aae3-88aa57506f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Flow 'volume_create_manager' (976e8953-15bb-4879-9da1-bac569aab23f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:05:31 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-d6d9a696-e7e7-41c0-93c3-c0eef65ffeb5 tempest-VolumesGetTest-1877134668 None] Created volume successfully. Sep 21 12:05:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-495cab18-6140-4d74-a9c5-135492a5cb55 req-6b5f08bf-3093-4116-9fa5-bb687dd7b9eb tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d', 'name': 'volume-d7fdffa4-ef8e-400d-8119-61f0450a0abf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a0bbfb11-750f-49c4-a1b7-19c4aba82286', 'enforce_multipath': True} {{(pid=86366) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 12:05:31 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-495cab18-6140-4d74-a9c5-135492a5cb55 req-6b5f08bf-3093-4116-9fa5-bb687dd7b9eb tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] attachment_update completed successfully. Sep 21 12:05:32 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b1ef791d-7039-4478-84a0-920e24798c25 tempest-VolumesGetTest-1877134668 None] Acquiring lock "cinder-33883402-4860-4fbc-a8ee-ea909444783d-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:05:32 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b1ef791d-7039-4478-84a0-920e24798c25 tempest-VolumesGetTest-1877134668 None] Lock "cinder-33883402-4860-4fbc-a8ee-ea909444783d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:05:32 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b1ef791d-7039-4478-84a0-920e24798c25 tempest-VolumesGetTest-1877134668 None] Acquiring lock "cinder-quobyte-33883402-4860-4fbc-a8ee-ea909444783d" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:05:32 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b1ef791d-7039-4478-84a0-920e24798c25 tempest-VolumesGetTest-1877134668 None] Lock "cinder-quobyte-33883402-4860-4fbc-a8ee-ea909444783d" acquired by "delete_volume" :: waited 0.041s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:05:32 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[239ced02-2dc6-4d25-a114-39a4f4e61a93]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:05:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b1ef791d-7039-4478-84a0-920e24798c25 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-33883402-4860-4fbc-a8ee-ea909444783d {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:32 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-33883402-4860-4fbc-a8ee-ea909444783d Sep 21 12:05:32 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:32 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b1ef791d-7039-4478-84a0-920e24798c25 tempest-VolumesGetTest-1877134668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-33883402-4860-4fbc-a8ee-ea909444783d" returned: 0 in 0.551s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b1ef791d-7039-4478-84a0-920e24798c25 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-33883402-4860-4fbc-a8ee-ea909444783d {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:32 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-33883402-4860-4fbc-a8ee-ea909444783d Sep 21 12:05:32 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:33 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b1ef791d-7039-4478-84a0-920e24798c25 tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-33883402-4860-4fbc-a8ee-ea909444783d" returned: 0 in 0.379s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b1ef791d-7039-4478-84a0-920e24798c25 tempest-VolumesGetTest-1877134668 None] Lock "cinder-quobyte-33883402-4860-4fbc-a8ee-ea909444783d" released by "delete_volume" :: held 1.013s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:05:33 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-b1ef791d-7039-4478-84a0-920e24798c25 tempest-VolumesGetTest-1877134668 None] Created reservations ['b5190e4b-f2a5-4722-9943-e2ae71d238bd', 'f447588c-48c0-4564-bcfd-b023ff4ca35c', '7e551cff-7317-4cf8-9d27-fc6f6c771f62', 'a41f8527-5316-49e3-9b0a-71e5f3cf432b'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:05:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b1ef791d-7039-4478-84a0-920e24798c25 tempest-VolumesGetTest-1877134668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:05:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b1ef791d-7039-4478-84a0-920e24798c25 tempest-VolumesGetTest-1877134668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:05:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b1ef791d-7039-4478-84a0-920e24798c25 tempest-VolumesGetTest-1877134668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:05:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b1ef791d-7039-4478-84a0-920e24798c25 tempest-VolumesGetTest-1877134668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:05:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b1ef791d-7039-4478-84a0-920e24798c25 tempest-VolumesGetTest-1877134668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:05:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b1ef791d-7039-4478-84a0-920e24798c25 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:33 devstack sudo[100690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:05:33 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:33 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b1ef791d-7039-4478-84a0-920e24798c25 tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.338s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:33 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-b1ef791d-7039-4478-84a0-920e24798c25 tempest-VolumesGetTest-1877134668 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:05:33 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-b1ef791d-7039-4478-84a0-920e24798c25 tempest-VolumesGetTest-1877134668 None] Deleted volume successfully. Sep 21 12:05:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b1ef791d-7039-4478-84a0-920e24798c25 tempest-VolumesGetTest-1877134668 None] Lock "cinder-33883402-4860-4fbc-a8ee-ea909444783d-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:05:34 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c16ce4ad-817d-42ad-9283-26c96d8ff5de tempest-VolumesGetTest-1877134668 None] Acquiring lock "cinder-b1fd2a25-fd53-4341-9040-58ff52090a35-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:05:34 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c16ce4ad-817d-42ad-9283-26c96d8ff5de tempest-VolumesGetTest-1877134668 None] Lock "cinder-b1fd2a25-fd53-4341-9040-58ff52090a35-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:05:34 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c16ce4ad-817d-42ad-9283-26c96d8ff5de tempest-VolumesGetTest-1877134668 None] Acquiring lock "cinder-quobyte-b1fd2a25-fd53-4341-9040-58ff52090a35" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:05:34 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c16ce4ad-817d-42ad-9283-26c96d8ff5de tempest-VolumesGetTest-1877134668 None] Lock "cinder-quobyte-b1fd2a25-fd53-4341-9040-58ff52090a35" acquired by "delete_volume" :: waited 0.034s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:05:34 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf496f4-cade-4e9e-a904-4e0f679aad15]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:05:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c16ce4ad-817d-42ad-9283-26c96d8ff5de tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b1fd2a25-fd53-4341-9040-58ff52090a35 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:34 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b1fd2a25-fd53-4341-9040-58ff52090a35 Sep 21 12:05:34 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:35 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-72b12f72-9c07-4f14-893c-dfb1fb85d713 req-d19d709d-8978-4ed3-ba7e-ea6122fc4951 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Terminate volume connection completed successfully. Sep 21 12:05:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-72b12f72-9c07-4f14-893c-dfb1fb85d713 req-d19d709d-8978-4ed3-ba7e-ea6122fc4951 tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Deleting attachment a0bbfb11-750f-49c4-a1b7-19c4aba82286. {{(pid=86366) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 12:05:35 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c16ce4ad-817d-42ad-9283-26c96d8ff5de tempest-VolumesGetTest-1877134668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b1fd2a25-fd53-4341-9040-58ff52090a35" returned: 0 in 0.521s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c16ce4ad-817d-42ad-9283-26c96d8ff5de tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b1fd2a25-fd53-4341-9040-58ff52090a35 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:35 devstack sudo[100725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b1fd2a25-fd53-4341-9040-58ff52090a35 Sep 21 12:05:35 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:35 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c16ce4ad-817d-42ad-9283-26c96d8ff5de tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-b1fd2a25-fd53-4341-9040-58ff52090a35" returned: 0 in 0.370s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:35 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c16ce4ad-817d-42ad-9283-26c96d8ff5de tempest-VolumesGetTest-1877134668 None] Lock "cinder-quobyte-b1fd2a25-fd53-4341-9040-58ff52090a35" released by "delete_volume" :: held 0.983s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:05:35 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-c16ce4ad-817d-42ad-9283-26c96d8ff5de tempest-VolumesGetTest-1877134668 None] Created reservations ['319b276e-0e98-47e8-97f0-cae3c230d49c', 'b6c3142d-a909-4d99-9dad-dcb15c4f34a5', '201dd6ee-ef60-4a2f-8c01-1ad764e89936', 'f2b5899d-991e-4cc6-9d2e-40f30982266e'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:05:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c16ce4ad-817d-42ad-9283-26c96d8ff5de tempest-VolumesGetTest-1877134668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:05:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c16ce4ad-817d-42ad-9283-26c96d8ff5de tempest-VolumesGetTest-1877134668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:05:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c16ce4ad-817d-42ad-9283-26c96d8ff5de tempest-VolumesGetTest-1877134668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:05:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c16ce4ad-817d-42ad-9283-26c96d8ff5de tempest-VolumesGetTest-1877134668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:05:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c16ce4ad-817d-42ad-9283-26c96d8ff5de tempest-VolumesGetTest-1877134668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:05:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c16ce4ad-817d-42ad-9283-26c96d8ff5de tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:36 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:05:36 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:36 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-09201264-3d21-4dc8-91fe-e127e59e20ae tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Acquiring lock "cinder-d7fdffa4-ef8e-400d-8119-61f0450a0abf-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:05:36 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-09201264-3d21-4dc8-91fe-e127e59e20ae tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Lock "cinder-d7fdffa4-ef8e-400d-8119-61f0450a0abf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:05:36 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-09201264-3d21-4dc8-91fe-e127e59e20ae tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Acquiring lock "cinder-quobyte-d7fdffa4-ef8e-400d-8119-61f0450a0abf" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:05:36 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-09201264-3d21-4dc8-91fe-e127e59e20ae tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Lock "cinder-quobyte-d7fdffa4-ef8e-400d-8119-61f0450a0abf" acquired by "delete_volume" :: waited 0.023s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:05:36 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e052ef-fe1b-4088-9e7a-68d8e49757be]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:05:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-09201264-3d21-4dc8-91fe-e127e59e20ae tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d7fdffa4-ef8e-400d-8119-61f0450a0abf {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:36 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c16ce4ad-817d-42ad-9283-26c96d8ff5de tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.425s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:36 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-c16ce4ad-817d-42ad-9283-26c96d8ff5de tempest-VolumesGetTest-1877134668 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:05:36 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-c16ce4ad-817d-42ad-9283-26c96d8ff5de tempest-VolumesGetTest-1877134668 None] Deleted volume successfully. Sep 21 12:05:36 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c16ce4ad-817d-42ad-9283-26c96d8ff5de tempest-VolumesGetTest-1877134668 None] Lock "cinder-b1fd2a25-fd53-4341-9040-58ff52090a35-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:05:36 devstack sudo[100731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d7fdffa4-ef8e-400d-8119-61f0450a0abf Sep 21 12:05:36 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:36 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-09201264-3d21-4dc8-91fe-e127e59e20ae tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d7fdffa4-ef8e-400d-8119-61f0450a0abf" returned: 0 in 0.472s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-09201264-3d21-4dc8-91fe-e127e59e20ae tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d7fdffa4-ef8e-400d-8119-61f0450a0abf {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:36 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d7fdffa4-ef8e-400d-8119-61f0450a0abf Sep 21 12:05:36 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-36bcca8c-d3e3-4cb9-a8a0-1c32dfff5598 tempest-VolumesGetTest-1877134668 None] Acquiring lock "cinder-1efb8e04-51da-4e10-8b5a-85f068321396-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:05:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-36bcca8c-d3e3-4cb9-a8a0-1c32dfff5598 tempest-VolumesGetTest-1877134668 None] Lock "cinder-1efb8e04-51da-4e10-8b5a-85f068321396-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:05:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-36bcca8c-d3e3-4cb9-a8a0-1c32dfff5598 tempest-VolumesGetTest-1877134668 None] Acquiring lock "cinder-quobyte-1efb8e04-51da-4e10-8b5a-85f068321396" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:05:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-36bcca8c-d3e3-4cb9-a8a0-1c32dfff5598 tempest-VolumesGetTest-1877134668 None] Lock "cinder-quobyte-1efb8e04-51da-4e10-8b5a-85f068321396" acquired by "delete_volume" :: waited 0.025s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:05:37 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-09201264-3d21-4dc8-91fe-e127e59e20ae tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d7fdffa4-ef8e-400d-8119-61f0450a0abf" returned: 0 in 0.470s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-09201264-3d21-4dc8-91fe-e127e59e20ae tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Lock "cinder-quobyte-d7fdffa4-ef8e-400d-8119-61f0450a0abf" released by "delete_volume" :: held 1.017s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:05:37 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28c74c8-07cd-43df-aff6-406d2e822ffd]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:05:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-36bcca8c-d3e3-4cb9-a8a0-1c32dfff5598 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:37 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-09201264-3d21-4dc8-91fe-e127e59e20ae tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Created reservations ['7bd3420e-e2e1-49f0-9630-06d0d264a9f8', 'acadd742-77b4-446d-a57d-88b628bac33a', '7482c9a9-a598-4a22-beb0-006097e83bef', 'd438cabd-3692-4b7d-9278-f686ce091c52'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:05:37 devstack sudo[100739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396 Sep 21 12:05:37 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-09201264-3d21-4dc8-91fe-e127e59e20ae tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:05:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-09201264-3d21-4dc8-91fe-e127e59e20ae tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:05:37 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-09201264-3d21-4dc8-91fe-e127e59e20ae tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:05:37 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-09201264-3d21-4dc8-91fe-e127e59e20ae tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:05:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-09201264-3d21-4dc8-91fe-e127e59e20ae tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:05:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-09201264-3d21-4dc8-91fe-e127e59e20ae tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:37 devstack sudo[100741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:05:37 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:37 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-36bcca8c-d3e3-4cb9-a8a0-1c32dfff5598 tempest-VolumesGetTest-1877134668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396" returned: 0 in 0.571s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-36bcca8c-d3e3-4cb9-a8a0-1c32dfff5598 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:37 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396 Sep 21 12:05:37 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:37 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-09201264-3d21-4dc8-91fe-e127e59e20ae tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.379s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:37 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-09201264-3d21-4dc8-91fe-e127e59e20ae tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:05:37 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-09201264-3d21-4dc8-91fe-e127e59e20ae tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Deleted volume successfully. Sep 21 12:05:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-09201264-3d21-4dc8-91fe-e127e59e20ae tempest-TestServerVolumeAttachScenarioOldVersion-2054673338 None] Lock "cinder-d7fdffa4-ef8e-400d-8119-61f0450a0abf-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:05:38 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-36bcca8c-d3e3-4cb9-a8a0-1c32dfff5598 tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1efb8e04-51da-4e10-8b5a-85f068321396" returned: 0 in 0.381s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-36bcca8c-d3e3-4cb9-a8a0-1c32dfff5598 tempest-VolumesGetTest-1877134668 None] Lock "cinder-quobyte-1efb8e04-51da-4e10-8b5a-85f068321396" released by "delete_volume" :: held 1.096s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:05:38 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-36bcca8c-d3e3-4cb9-a8a0-1c32dfff5598 tempest-VolumesGetTest-1877134668 None] Created reservations ['52234a56-8184-46a3-a6ad-e06b48954271', 'f2b7acae-d7b1-48c6-98a2-95af0a06c49d', '9519de81-d057-4223-aaa6-1d6c821efd1b', 'fc006bf2-2d25-47c1-a3b8-9e16f2c8583b'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:05:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-36bcca8c-d3e3-4cb9-a8a0-1c32dfff5598 tempest-VolumesGetTest-1877134668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:05:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-36bcca8c-d3e3-4cb9-a8a0-1c32dfff5598 tempest-VolumesGetTest-1877134668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:05:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-36bcca8c-d3e3-4cb9-a8a0-1c32dfff5598 tempest-VolumesGetTest-1877134668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:05:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-36bcca8c-d3e3-4cb9-a8a0-1c32dfff5598 tempest-VolumesGetTest-1877134668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:05:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-36bcca8c-d3e3-4cb9-a8a0-1c32dfff5598 tempest-VolumesGetTest-1877134668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:05:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-36bcca8c-d3e3-4cb9-a8a0-1c32dfff5598 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:38 devstack sudo[100751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:05:38 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:38 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-36bcca8c-d3e3-4cb9-a8a0-1c32dfff5598 tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.326s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:38 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-36bcca8c-d3e3-4cb9-a8a0-1c32dfff5598 tempest-VolumesGetTest-1877134668 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:05:38 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-36bcca8c-d3e3-4cb9-a8a0-1c32dfff5598 tempest-VolumesGetTest-1877134668 None] Deleted volume successfully. Sep 21 12:05:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-36bcca8c-d3e3-4cb9-a8a0-1c32dfff5598 tempest-VolumesGetTest-1877134668 None] Lock "cinder-1efb8e04-51da-4e10-8b5a-85f068321396-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:05:40 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:05:40 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Flow 'volume_create_manager' (e96f1a1a-9569-4883-91f9-4d496e398651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:05:40 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4968fa0d-176a-4227-ba6e-0ef73f96c005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:40 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4968fa0d-176a-4227-ba6e-0ef73f96c005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-734929583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9d4e3f-54c6-4eee-826b-914b54407c61,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c183949a75984aad9712c44ddd7f291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:05:40Z,use_quota=True,user_id='a477515563f342dea8931e50cf28fbc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:40 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f46794-cd42-4583-abd1-e4533a9d5933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:40 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f46794-cd42-4583-abd1-e4533a9d5933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:40 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0750b2-2132-4867-8635-327ed5e2159a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:40 devstack cinder-volume[86366]: DEBUG cinder.image.glance [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Creating Keystone auth plugin from conf {{(pid=86366) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 21 12:05:40 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0750b2-2132-4867-8635-327ed5e2159a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1d9d4e3f-54c6-4eee-826b-914b54407c61', 'volume_name': 'volume-1d9d4e3f-54c6-4eee-826b-914b54407c61', 'volume_size': 1, 'image_id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6c23462c1d34d9a9d8fbc8d8872d421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'created_at': datetime.datetime(2026, 9, 21, 9, 44, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 9, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:40 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e7fe53-862d-47a5-ac48-6267198789e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:40 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e7fe53-862d-47a5-ac48-6267198789e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:40 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05fdf0aa-ec99-4999-95be-38d85e85fa17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:40 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Volume 1d9d4e3f-54c6-4eee-826b-914b54407c61: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1d9d4e3f-54c6-4eee-826b-914b54407c61', 'volume_size': 1, 'image_id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6c23462c1d34d9a9d8fbc8d8872d421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'created_at': datetime.datetime(2026, 9, 21, 9, 44, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 9, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 21 12:05:40 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Trying to clone 1d9d4e3f-54c6-4eee-826b-914b54407c61 from image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}]). {{(pid=86366) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 21 12:05:41 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_ad3n_19ndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 21 12:05:41 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Image download 20.69 MB at 20.69 MB/s Sep 21 12:05:41 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f151db-5f68-41f1-b0d6-9c79fd14196f]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:05:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_ad3n_19ndevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:41 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_ad3n_19ndevstack@QuobyteHD Sep 21 12:05:41 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:41 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_ad3n_19ndevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:41 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Temporary image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 is fetched for user a477515563f342dea8931e50cf28fbc1. {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 21 12:05:42 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe0db03-6235-402b-b585-f423f0b0c95a]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:05:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_ad3n_19ndevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:42 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_ad3n_19ndevstack@QuobyteHD Sep 21 12:05:42 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:42 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_ad3n_19ndevstack@QuobyteHD" returned: 0 in 0.536s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:05:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:05:42 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-734929583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9d4e3f-54c6-4eee-826b-914b54407c61,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c183949a75984aad9712c44ddd7f291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:05:40Z,use_quota=True,user_id='a477515563f342dea8931e50cf28fbc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:05:42 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Creating volume 1d9d4e3f-54c6-4eee-826b-914b54407c61 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:05:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:05:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:05:42 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:05:42 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:05:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:05:42 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:05:42 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:05:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1d9d4e3f-54c6-4eee-826b-914b54407c61 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:42 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1d9d4e3f-54c6-4eee-826b-914b54407c61 1073741824 Sep 21 12:05:42 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:43 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1d9d4e3f-54c6-4eee-826b-914b54407c61 1073741824" returned: 0 in 0.654s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1d9d4e3f-54c6-4eee-826b-914b54407c61 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:43 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1d9d4e3f-54c6-4eee-826b-914b54407c61 Sep 21 12:05:43 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:43 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1d9d4e3f-54c6-4eee-826b-914b54407c61" returned: 0 in 0.368s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:43 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:05:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:05:43 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Attempting download of 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 ((None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}])) to volume 1d9d4e3f-54c6-4eee-826b-914b54407c61. {{(pid=86366) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 21 12:05:43 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de6afbd-02ae-4931-a639-b4df30adb0a4]: (4, 'raw') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:05:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_zdbitvzz {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:43 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_zdbitvzz Sep 21 12:05:43 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:44 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_zdbitvzz" returned: 0 in 0.433s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_zdbitvzz {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:44 devstack sudo[100804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_zdbitvzz Sep 21 12:05:44 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:44 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_zdbitvzz" returned: 1 in 0.421s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_zdbitvzz' failed. Not Retrying. {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 12:05:44 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1a5bb5-c439-443d-bf54-0e4152a6e5b8]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:05:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_ad3n_19ndevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:44 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_ad3n_19ndevstack@QuobyteHD Sep 21 12:05:44 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:45 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_ad3n_19ndevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:45 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 was qcow2, converting to qcow2 {{(pid=86366) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 21 12:05:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_ad3n_19ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1d9d4e3f-54c6-4eee-826b-914b54407c61 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:45 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_ad3n_19ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1d9d4e3f-54c6-4eee-826b-914b54407c61 Sep 21 12:05:45 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:46 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:05:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Flow 'volume_create_manager' (bfd128c8-438f-41ed-9b8e-bad9cd795a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:05:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f767a587-02a2-45d5-beeb-13d42c7cf207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f767a587-02a2-45d5-beeb-13d42c7cf207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-356850913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=241e3e59-081b-4241-b3de-75aafd49db55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c434e30238f4432088e69b0dbd1ce4bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:05:46Z,use_quota=True,user_id='8a70ff09abb44ca9b2f9a9f95a4de407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e5ccadd-fdeb-4832-88fe-c43b682deb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e5ccadd-fdeb-4832-88fe-c43b682deb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67666ca4-e01f-49e3-b345-87baf6cf24a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67666ca4-e01f-49e3-b345-87baf6cf24a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '241e3e59-081b-4241-b3de-75aafd49db55', 'volume_name': 'volume-241e3e59-081b-4241-b3de-75aafd49db55', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee420be-cb6e-4dfe-ac28-854ce2afdb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee420be-cb6e-4dfe-ac28-854ce2afdb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c6b174-813d-4114-948e-08d3533f7809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:46 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Volume 241e3e59-081b-4241-b3de-75aafd49db55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-241e3e59-081b-4241-b3de-75aafd49db55', 'volume_size': 1} Sep 21 12:05:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:05:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:05:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-356850913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=241e3e59-081b-4241-b3de-75aafd49db55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c434e30238f4432088e69b0dbd1ce4bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:05:46Z,use_quota=True,user_id='8a70ff09abb44ca9b2f9a9f95a4de407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:05:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Creating volume 241e3e59-081b-4241-b3de-75aafd49db55 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:05:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:05:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:05:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:05:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:05:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:05:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:05:46 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:05:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:46 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55 1073741824 Sep 21 12:05:46 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:46 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55 1073741824" returned: 0 in 0.722s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:47 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55 Sep 21 12:05:47 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:47 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55" returned: 0 in 0.299s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:47 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:05:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:05:47 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c6b174-813d-4114-948e-08d3533f7809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-241e3e59-081b-4241-b3de-75aafd49db55', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:47 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ae68ae-7fd9-43cd-b1bb-53ecd9e308c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:47 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Volume volume-241e3e59-081b-4241-b3de-75aafd49db55 (241e3e59-081b-4241-b3de-75aafd49db55): created successfully Sep 21 12:05:47 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ae68ae-7fd9-43cd-b1bb-53ecd9e308c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:47 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Flow 'volume_create_manager' (bfd128c8-438f-41ed-9b8e-bad9cd795a60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:05:47 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-042b2847-767e-4699-9747-c5805554894d tempest-TestStampPattern-1856543467 None] Created volume successfully. Sep 21 12:05:47 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_ad3n_19ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1d9d4e3f-54c6-4eee-826b-914b54407c61" returned: 0 in 2.651s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:47 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_ad3n_19ndevstack@QuobyteHD, size 112.00 MB, duration 2.65 sec, destination /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1d9d4e3f-54c6-4eee-826b-914b54407c61 {{(pid=86366) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 12:05:47 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Converted 112.00 MB image at 42.23 MB/s Sep 21 12:05:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1d9d4e3f-54c6-4eee-826b-914b54407c61 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:47 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1d9d4e3f-54c6-4eee-826b-914b54407c61 1G Sep 21 12:05:47 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:48 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1d9d4e3f-54c6-4eee-826b-914b54407c61 1G" returned: 0 in 0.430s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:48 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Downloaded image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 ((None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}])) to volume 1d9d4e3f-54c6-4eee-826b-914b54407c61 successfully. {{(pid=86366) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 21 12:05:48 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Temporary image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 for user a477515563f342dea8931e50cf28fbc1 is deleted. {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 21 12:05:48 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Marking volume 1d9d4e3f-54c6-4eee-826b-914b54407c61 as bootable. {{(pid=86366) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 21 12:05:48 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Copying metadata from image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 to 1d9d4e3f-54c6-4eee-826b-914b54407c61. {{(pid=86366) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 21 12:05:48 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Creating volume glance metadata for volume 1d9d4e3f-54c6-4eee-826b-914b54407c61 backed by image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86366) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 21 12:05:48 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05fdf0aa-ec99-4999-95be-38d85e85fa17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d9d4e3f-54c6-4eee-826b-914b54407c61', 'volume_size': 1, 'image_id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6c23462c1d34d9a9d8fbc8d8872d421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'created_at': datetime.datetime(2026, 9, 21, 9, 44, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 9, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:48 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5fb92df-041c-4bb2-a7d7-34f9fbb0e8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:48 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Volume volume-1d9d4e3f-54c6-4eee-826b-914b54407c61 (1d9d4e3f-54c6-4eee-826b-914b54407c61): created successfully Sep 21 12:05:48 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5fb92df-041c-4bb2-a7d7-34f9fbb0e8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:48 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Flow 'volume_create_manager' (e96f1a1a-9569-4883-91f9-4d496e398651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:05:48 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-05d7d8a3-3ff9-4416-8f5b-df9a5ec449b0 tempest-VolumesGetTest-1877134668 None] Created volume successfully. Sep 21 12:05:50 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=92,cinder:UPDATE=106,cinder:DELETE=9,cinder:INSERT=31 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:05:50 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=94,cinder:UPDATE=122,cinder:INSERT=35,cinder:DELETE=11 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:05:50 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:05:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Flow 'volume_create_manager' (e1d61517-3053-45a1-9594-6197810d5a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:05:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf03770b-c38a-4b3d-9632-ca72dd7f9570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf03770b-c38a-4b3d-9632-ca72dd7f9570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:05:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1593091039',display_name='tempest-VolumesGetTest-Volume-1876372730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1147fb74-6104-4ee1-b8e1-241b484c677c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c183949a75984aad9712c44ddd7f291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:05:50Z,use_quota=True,user_id='a477515563f342dea8931e50cf28fbc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3359bde1-34d4-4362-bfcb-32a5455a10d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3359bde1-34d4-4362-bfcb-32a5455a10d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa78e27c-db16-4eb6-a81a-87a64b9c3089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa78e27c-db16-4eb6-a81a-87a64b9c3089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1147fb74-6104-4ee1-b8e1-241b484c677c', 'volume_name': 'volume-1147fb74-6104-4ee1-b8e1-241b484c677c', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04a4da1-1cab-417c-b83c-9176ed5b3dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04a4da1-1cab-417c-b83c-9176ed5b3dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e384544f-aae6-4aae-96df-520a42451d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:50 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Volume 1147fb74-6104-4ee1-b8e1-241b484c677c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1147fb74-6104-4ee1-b8e1-241b484c677c', 'volume_size': 1} Sep 21 12:05:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:05:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:05:50 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:05:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1593091039',display_name='tempest-VolumesGetTest-Volume-1876372730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1147fb74-6104-4ee1-b8e1-241b484c677c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c183949a75984aad9712c44ddd7f291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:05:50Z,use_quota=True,user_id='a477515563f342dea8931e50cf28fbc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:05:50 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Creating volume 1147fb74-6104-4ee1-b8e1-241b484c677c {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:05:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:05:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:05:50 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:05:50 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:05:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:05:50 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:05:50 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:05:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1147fb74-6104-4ee1-b8e1-241b484c677c 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:50 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1147fb74-6104-4ee1-b8e1-241b484c677c 1073741824 Sep 21 12:05:50 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:50 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1147fb74-6104-4ee1-b8e1-241b484c677c 1073741824" returned: 0 in 0.575s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1147fb74-6104-4ee1-b8e1-241b484c677c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:50 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1147fb74-6104-4ee1-b8e1-241b484c677c Sep 21 12:05:50 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:51 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1147fb74-6104-4ee1-b8e1-241b484c677c" returned: 0 in 0.286s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:05:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:05:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e384544f-aae6-4aae-96df-520a42451d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1147fb74-6104-4ee1-b8e1-241b484c677c', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1ad953-ce5a-48e2-a750-04d0e854908b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:05:51 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Volume volume-1147fb74-6104-4ee1-b8e1-241b484c677c (1147fb74-6104-4ee1-b8e1-241b484c677c): created successfully Sep 21 12:05:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1ad953-ce5a-48e2-a750-04d0e854908b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:05:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Flow 'volume_create_manager' (e1d61517-3053-45a1-9594-6197810d5a23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:05:51 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-6379766a-8ea0-4a7a-a086-69f9bfcd6eac tempest-VolumesGetTest-1877134668 None] Created volume successfully. Sep 21 12:05:52 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4d0254fd-f09a-4fa9-b96e-0494ab4c996a tempest-VolumesGetTest-1877134668 None] Acquiring lock "cinder-1147fb74-6104-4ee1-b8e1-241b484c677c-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:05:52 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4d0254fd-f09a-4fa9-b96e-0494ab4c996a tempest-VolumesGetTest-1877134668 None] Lock "cinder-1147fb74-6104-4ee1-b8e1-241b484c677c-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:05:52 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4d0254fd-f09a-4fa9-b96e-0494ab4c996a tempest-VolumesGetTest-1877134668 None] Acquiring lock "cinder-quobyte-1147fb74-6104-4ee1-b8e1-241b484c677c" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:05:52 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4d0254fd-f09a-4fa9-b96e-0494ab4c996a tempest-VolumesGetTest-1877134668 None] Lock "cinder-quobyte-1147fb74-6104-4ee1-b8e1-241b484c677c" acquired by "delete_volume" :: waited 0.035s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:05:52 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da12247-2fd1-4946-8202-4eaf2d4fc7bd]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:05:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4d0254fd-f09a-4fa9-b96e-0494ab4c996a tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1147fb74-6104-4ee1-b8e1-241b484c677c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:52 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1147fb74-6104-4ee1-b8e1-241b484c677c Sep 21 12:05:52 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:53 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4d0254fd-f09a-4fa9-b96e-0494ab4c996a tempest-VolumesGetTest-1877134668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1147fb74-6104-4ee1-b8e1-241b484c677c" returned: 0 in 0.650s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4d0254fd-f09a-4fa9-b96e-0494ab4c996a tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1147fb74-6104-4ee1-b8e1-241b484c677c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:53 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1147fb74-6104-4ee1-b8e1-241b484c677c Sep 21 12:05:53 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:54 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4d0254fd-f09a-4fa9-b96e-0494ab4c996a tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1147fb74-6104-4ee1-b8e1-241b484c677c" returned: 0 in 0.610s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4d0254fd-f09a-4fa9-b96e-0494ab4c996a tempest-VolumesGetTest-1877134668 None] Lock "cinder-quobyte-1147fb74-6104-4ee1-b8e1-241b484c677c" released by "delete_volume" :: held 1.359s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:05:54 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-4d0254fd-f09a-4fa9-b96e-0494ab4c996a tempest-VolumesGetTest-1877134668 None] Created reservations ['9dc5cef0-0b08-44fb-8d1a-11940b78e4c6', '17438bc1-4c03-43f8-8453-7c7dcd224a02', '5d28005f-2fa4-46b1-a4da-9f3a798d61a5', '2bf5c3fd-2739-4d0b-80c3-9b652a84e22c'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:05:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4d0254fd-f09a-4fa9-b96e-0494ab4c996a tempest-VolumesGetTest-1877134668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:05:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4d0254fd-f09a-4fa9-b96e-0494ab4c996a tempest-VolumesGetTest-1877134668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:05:54 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4d0254fd-f09a-4fa9-b96e-0494ab4c996a tempest-VolumesGetTest-1877134668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:05:54 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4d0254fd-f09a-4fa9-b96e-0494ab4c996a tempest-VolumesGetTest-1877134668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:05:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4d0254fd-f09a-4fa9-b96e-0494ab4c996a tempest-VolumesGetTest-1877134668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:05:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4d0254fd-f09a-4fa9-b96e-0494ab4c996a tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:54 devstack sudo[100978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:05:54 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:54 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4d0254fd-f09a-4fa9-b96e-0494ab4c996a tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.421s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:54 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-4d0254fd-f09a-4fa9-b96e-0494ab4c996a tempest-VolumesGetTest-1877134668 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:05:54 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-4d0254fd-f09a-4fa9-b96e-0494ab4c996a tempest-VolumesGetTest-1877134668 None] Deleted volume successfully. Sep 21 12:05:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4d0254fd-f09a-4fa9-b96e-0494ab4c996a tempest-VolumesGetTest-1877134668 None] Lock "cinder-1147fb74-6104-4ee1-b8e1-241b484c677c-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:05:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-432a1051-bebe-40f4-ac56-fe25e220a8cc tempest-VolumesGetTest-1877134668 None] Acquiring lock "cinder-1d9d4e3f-54c6-4eee-826b-914b54407c61-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:05:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-432a1051-bebe-40f4-ac56-fe25e220a8cc tempest-VolumesGetTest-1877134668 None] Lock "cinder-1d9d4e3f-54c6-4eee-826b-914b54407c61-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:05:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-432a1051-bebe-40f4-ac56-fe25e220a8cc tempest-VolumesGetTest-1877134668 None] Acquiring lock "cinder-quobyte-1d9d4e3f-54c6-4eee-826b-914b54407c61" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:05:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-432a1051-bebe-40f4-ac56-fe25e220a8cc tempest-VolumesGetTest-1877134668 None] Lock "cinder-quobyte-1d9d4e3f-54c6-4eee-826b-914b54407c61" acquired by "delete_volume" :: waited 0.034s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:05:55 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1db2c6-901a-4d1f-af1e-e1ff6c5bfd4e]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:05:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-432a1051-bebe-40f4-ac56-fe25e220a8cc tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1d9d4e3f-54c6-4eee-826b-914b54407c61 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:55 devstack sudo[100983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1d9d4e3f-54c6-4eee-826b-914b54407c61 Sep 21 12:05:55 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:55 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-432a1051-bebe-40f4-ac56-fe25e220a8cc tempest-VolumesGetTest-1877134668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1d9d4e3f-54c6-4eee-826b-914b54407c61" returned: 0 in 0.505s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-432a1051-bebe-40f4-ac56-fe25e220a8cc tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1d9d4e3f-54c6-4eee-826b-914b54407c61 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:55 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1d9d4e3f-54c6-4eee-826b-914b54407c61 Sep 21 12:05:55 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:56 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-432a1051-bebe-40f4-ac56-fe25e220a8cc tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1d9d4e3f-54c6-4eee-826b-914b54407c61" returned: 0 in 0.502s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-432a1051-bebe-40f4-ac56-fe25e220a8cc tempest-VolumesGetTest-1877134668 None] Lock "cinder-quobyte-1d9d4e3f-54c6-4eee-826b-914b54407c61" released by "delete_volume" :: held 1.094s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:05:56 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-432a1051-bebe-40f4-ac56-fe25e220a8cc tempest-VolumesGetTest-1877134668 None] Created reservations ['300d6d47-150a-4990-bb50-94ab659fc401', '80534e73-8ee9-4679-bf32-a0fa1952ccdc', 'e2bd85bf-c296-4ff9-adfa-3a45508714a4', '1fcecd30-9486-4c13-832c-3f11740fff17'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:05:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-432a1051-bebe-40f4-ac56-fe25e220a8cc tempest-VolumesGetTest-1877134668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:05:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-432a1051-bebe-40f4-ac56-fe25e220a8cc tempest-VolumesGetTest-1877134668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:05:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-432a1051-bebe-40f4-ac56-fe25e220a8cc tempest-VolumesGetTest-1877134668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:05:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-432a1051-bebe-40f4-ac56-fe25e220a8cc tempest-VolumesGetTest-1877134668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:05:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-432a1051-bebe-40f4-ac56-fe25e220a8cc tempest-VolumesGetTest-1877134668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:05:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-432a1051-bebe-40f4-ac56-fe25e220a8cc tempest-VolumesGetTest-1877134668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:05:56 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:05:56 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:05:56 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Sep 21 12:05:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-432a1051-bebe-40f4-ac56-fe25e220a8cc tempest-VolumesGetTest-1877134668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.383s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:05:56 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-432a1051-bebe-40f4-ac56-fe25e220a8cc tempest-VolumesGetTest-1877134668 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:05:57 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-432a1051-bebe-40f4-ac56-fe25e220a8cc tempest-VolumesGetTest-1877134668 None] Deleted volume successfully. Sep 21 12:05:57 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-432a1051-bebe-40f4-ac56-fe25e220a8cc tempest-VolumesGetTest-1877134668 None] Lock "cinder-1d9d4e3f-54c6-4eee-826b-914b54407c61-delete_volume" released by "delete_volume" :: held 1.974s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:02 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:06:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Flow 'volume_create_manager' (759c6725-e12d-45ce-a230-c17f1a24f867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:06:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d93b34-1a0d-411c-a808-1ecd964cc487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d93b34-1a0d-411c-a808-1ecd964cc487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13478588-b725-42f1-8b24-b6a5cb13ccde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9852ed812e4a480c98053de02a190b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:06:02Z,use_quota=True,user_id='facc47112d7b4b7ebd4773a8094850f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6382fbf-2dc2-46f8-ace5-6c46e00bc964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6382fbf-2dc2-46f8-ace5-6c46e00bc964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd22653a-0d33-4ece-9044-2874bde5f924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd22653a-0d33-4ece-9044-2874bde5f924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13478588-b725-42f1-8b24-b6a5cb13ccde', 'volume_name': 'volume-13478588-b725-42f1-8b24-b6a5cb13ccde', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87aa8e6a-bae3-49d7-b197-d9c07a820751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87aa8e6a-bae3-49d7-b197-d9c07a820751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1236251f-37e6-4915-b8e7-6de778d0dbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:02 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Volume 13478588-b725-42f1-8b24-b6a5cb13ccde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13478588-b725-42f1-8b24-b6a5cb13ccde', 'volume_size': 1} Sep 21 12:06:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13478588-b725-42f1-8b24-b6a5cb13ccde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9852ed812e4a480c98053de02a190b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:06:02Z,use_quota=True,user_id='facc47112d7b4b7ebd4773a8094850f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:06:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Creating volume 13478588-b725-42f1-8b24-b6a5cb13ccde {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:06:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:06:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:06:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:06:02 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:06:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-13478588-b725-42f1-8b24-b6a5cb13ccde 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:02 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-13478588-b725-42f1-8b24-b6a5cb13ccde 1073741824 Sep 21 12:06:02 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:02 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Flow 'volume_create_manager' (69666e43-f587-416d-bfe1-3ce82d62a17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d94674-bca9-4993-a969-ca991911f3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d94674-bca9-4993-a969-ca991911f3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-872870312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=789b41f2-6470-4d10-b0c9-1254ea0460d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d0515cd9b44098b27b35f8320d4cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:06:03Z,use_quota=True,user_id='68a3a51574bb4cb6960fb2f007b573c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd935b1a-71f5-4e29-8d5c-c5bb4066e291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd935b1a-71f5-4e29-8d5c-c5bb4066e291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba301aa-04fe-4fc0-b4d6-1cfd9722a4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aba301aa-04fe-4fc0-b4d6-1cfd9722a4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '789b41f2-6470-4d10-b0c9-1254ea0460d2', 'volume_name': 'volume-789b41f2-6470-4d10-b0c9-1254ea0460d2', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425923b6-a224-4670-a59f-097d76a743b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425923b6-a224-4670-a59f-097d76a743b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90eaf02e-fb77-4ae7-a32e-d35d51d680c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:03 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Volume 789b41f2-6470-4d10-b0c9-1254ea0460d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-789b41f2-6470-4d10-b0c9-1254ea0460d2', 'volume_size': 1} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:03 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-13478588-b725-42f1-8b24-b6a5cb13ccde 1073741824" returned: 0 in 0.550s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-13478588-b725-42f1-8b24-b6a5cb13ccde {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:03 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-13478588-b725-42f1-8b24-b6a5cb13ccde Sep 21 12:06:03 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:03 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-13478588-b725-42f1-8b24-b6a5cb13ccde" returned: 0 in 0.257s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.325s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-872870312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=789b41f2-6470-4d10-b0c9-1254ea0460d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96d0515cd9b44098b27b35f8320d4cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:06:03Z,use_quota=True,user_id='68a3a51574bb4cb6960fb2f007b573c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Creating volume 789b41f2-6470-4d10-b0c9-1254ea0460d2 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:06:03 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1236251f-37e6-4915-b8e7-6de778d0dbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13478588-b725-42f1-8b24-b6a5cb13ccde', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:03 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2 1073741824 Sep 21 12:06:03 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1af2627c-7994-447a-9deb-5f2f00590772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:03 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Volume volume-13478588-b725-42f1-8b24-b6a5cb13ccde (13478588-b725-42f1-8b24-b6a5cb13ccde): created successfully Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1af2627c-7994-447a-9deb-5f2f00590772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Flow 'volume_create_manager' (759c6725-e12d-45ce-a230-c17f1a24f867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:06:03 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-5fe678eb-6c52-4be0-b686-279bbda13224 tempest-CinderUnicodeTest-55399551 None] Created volume successfully. Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:03 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:06:03 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:03 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2 1073741824" returned: 0 in 0.493s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:03 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2 Sep 21 12:06:03 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:03 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.280s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:06:03 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 12:06:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread count: 28 {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 12:06:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread info: [<_MainThread(MainThread, started 132841976594560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 12:06:04 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2" returned: 0 in 0.246s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:06:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90eaf02e-fb77-4ae7-a32e-d35d51d680c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-789b41f2-6470-4d10-b0c9-1254ea0460d2', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b51bfed6-3053-4ef2-a053-d8af784e3558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:04 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Volume volume-789b41f2-6470-4d10-b0c9-1254ea0460d2 (789b41f2-6470-4d10-b0c9-1254ea0460d2): created successfully Sep 21 12:06:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b51bfed6-3053-4ef2-a053-d8af784e3558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Flow 'volume_create_manager' (69666e43-f587-416d-bfe1-3ce82d62a17d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:06:04 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-3f7a5f06-0917-45cc-bbae-e09ce8a28def tempest-VolumesSnapshotListTestJSON-1550961070 None] Created volume successfully. Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Flow 'volume_create_manager' (7f611129-5d2b-4ea5-939e-0cd3669cce30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04ccacae-e9c2-4011-bad0-223f36e77636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04ccacae-e9c2-4011-bad0-223f36e77636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:06:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-465816434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab02b410-2c13-42b2-8bf7-215f4f6a9d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9852ed812e4a480c98053de02a190b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:06:05Z,use_quota=True,user_id='facc47112d7b4b7ebd4773a8094850f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fce02c5-5b87-4d9a-ab4a-c40a451855c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fce02c5-5b87-4d9a-ab4a-c40a451855c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1145ab7e-5644-46f5-bc97-25c445705e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1145ab7e-5644-46f5-bc97-25c445705e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab02b410-2c13-42b2-8bf7-215f4f6a9d7c', 'volume_name': 'volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d5c0003-586f-4701-aa21-8a3139c88354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d5c0003-586f-4701-aa21-8a3139c88354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4501c6a1-fcee-495d-9236-df1f6903b569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:05 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Volume ab02b410-2c13-42b2-8bf7-215f4f6a9d7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c', 'volume_size': 1} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:06:05Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-465816434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab02b410-2c13-42b2-8bf7-215f4f6a9d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9852ed812e4a480c98053de02a190b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:06:05Z,use_quota=True,user_id='facc47112d7b4b7ebd4773a8094850f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Creating volume ab02b410-2c13-42b2-8bf7-215f4f6a9d7c {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:06:05 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:05 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c 1073741824 Sep 21 12:06:05 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7906833b-9e5c-4858-8c57-5fdc045b12c6 tempest-VolumesSnapshotListTestJSON-1550961070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:05 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c 1073741824" returned: 0 in 0.479s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:05 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c Sep 21 12:06:05 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:05 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c" returned: 0 in 0.260s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7906833b-9e5c-4858-8c57-5fdc045b12c6 tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.572s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4501c6a1-fcee-495d-9236-df1f6903b569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (148687dc-97d3-4d6d-bfba-9770f6cee5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-7906833b-9e5c-4858-8c57-5fdc045b12c6 tempest-VolumesSnapshotListTestJSON-1550961070 None] Creating offline snapshot 686a4e0d-e4d9-4a2b-b2e1-40e78c729abb of volume 789b41f2-6470-4d10-b0c9-1254ea0460d2 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:06:05 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Volume volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c (ab02b410-2c13-42b2-8bf7-215f4f6a9d7c): created successfully Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (148687dc-97d3-4d6d-bfba-9770f6cee5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Flow 'volume_create_manager' (7f611129-5d2b-4ea5-939e-0cd3669cce30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c2877f-aac7-4c60-8e1d-68de3495f8ce]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:06:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7906833b-9e5c-4858-8c57-5fdc045b12c6 tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:05 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-a3ea8853-59ac-46e2-ba4b-a7fee6966153 tempest-CinderUnicodeTest-55399551 None] Created volume successfully. Sep 21 12:06:06 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2 Sep 21 12:06:06 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:06 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7906833b-9e5c-4858-8c57-5fdc045b12c6 tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2" returned: 0 in 0.415s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7906833b-9e5c-4858-8c57-5fdc045b12c6 tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:06 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb 1G Sep 21 12:06:06 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:06 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7906833b-9e5c-4858-8c57-5fdc045b12c6 tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb 1G" returned: 0 in 0.426s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7906833b-9e5c-4858-8c57-5fdc045b12c6 tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-789b41f2-6470-4d10-b0c9-1254ea0460d2 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:06 devstack sudo[101067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-789b41f2-6470-4d10-b0c9-1254ea0460d2 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb Sep 21 12:06:06 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:07 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7906833b-9e5c-4858-8c57-5fdc045b12c6 tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-789b41f2-6470-4d10-b0c9-1254ea0460d2 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb" returned: 0 in 0.295s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:07 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-7906833b-9e5c-4858-8c57-5fdc045b12c6 tempest-VolumesSnapshotListTestJSON-1550961070 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb is being set with open permissions: ugo+rw Sep 21 12:06:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7906833b-9e5c-4858-8c57-5fdc045b12c6 tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:07 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb Sep 21 12:06:07 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1d05d3dd-1688-483e-aba2-0dcf66b55830 tempest-CinderUnicodeTest-55399551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:07 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7906833b-9e5c-4858-8c57-5fdc045b12c6 tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb" returned: 0 in 0.269s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7906833b-9e5c-4858-8c57-5fdc045b12c6 tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:07 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.info Sep 21 12:06:07 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:07 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7906833b-9e5c-4858-8c57-5fdc045b12c6 tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.info" returned: 0 in 0.266s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:07 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-7906833b-9e5c-4858-8c57-5fdc045b12c6 tempest-VolumesSnapshotListTestJSON-1550961070 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.info is being set with open permissions: ugo+rw Sep 21 12:06:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7906833b-9e5c-4858-8c57-5fdc045b12c6 tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:07 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.info Sep 21 12:06:07 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:07 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7906833b-9e5c-4858-8c57-5fdc045b12c6 tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.info" returned: 0 in 0.247s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7906833b-9e5c-4858-8c57-5fdc045b12c6 tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.036s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1d05d3dd-1688-483e-aba2-0dcf66b55830 tempest-CinderUnicodeTest-55399551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.594s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1d05d3dd-1688-483e-aba2-0dcf66b55830 tempest-CinderUnicodeTest-55399551 None] Creating offline snapshot 9221ab2d-94a0-4c3c-8295-919463856516 of volume ab02b410-2c13-42b2-8bf7-215f4f6a9d7c {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:06:07 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-7906833b-9e5c-4858-8c57-5fdc045b12c6 tempest-VolumesSnapshotListTestJSON-1550961070 None] Create snapshot completed successfully Sep 21 12:06:07 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc913f4e-d61e-4b92-b252-02700ac5c064]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:06:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1d05d3dd-1688-483e-aba2-0dcf66b55830 tempest-CinderUnicodeTest-55399551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:08 devstack sudo[101082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c Sep 21 12:06:08 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:08 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1d05d3dd-1688-483e-aba2-0dcf66b55830 tempest-CinderUnicodeTest-55399551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c" returned: 0 in 0.353s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1d05d3dd-1688-483e-aba2-0dcf66b55830 tempest-CinderUnicodeTest-55399551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c.9221ab2d-94a0-4c3c-8295-919463856516 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:08 devstack sudo[101087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c.9221ab2d-94a0-4c3c-8295-919463856516 1G Sep 21 12:06:08 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a82ca235-1d98-4dfa-a884-2f4563920ef2 tempest-VolumesSnapshotListTestJSON-1550961070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:08 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1d05d3dd-1688-483e-aba2-0dcf66b55830 tempest-CinderUnicodeTest-55399551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c.9221ab2d-94a0-4c3c-8295-919463856516 1G" returned: 0 in 0.456s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1d05d3dd-1688-483e-aba2-0dcf66b55830 tempest-CinderUnicodeTest-55399551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c.9221ab2d-94a0-4c3c-8295-919463856516 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:08 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c.9221ab2d-94a0-4c3c-8295-919463856516 Sep 21 12:06:08 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:09 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1d05d3dd-1688-483e-aba2-0dcf66b55830 tempest-CinderUnicodeTest-55399551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c.9221ab2d-94a0-4c3c-8295-919463856516" returned: 0 in 0.278s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:09 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-1d05d3dd-1688-483e-aba2-0dcf66b55830 tempest-CinderUnicodeTest-55399551 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c.9221ab2d-94a0-4c3c-8295-919463856516 is being set with open permissions: ugo+rw Sep 21 12:06:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1d05d3dd-1688-483e-aba2-0dcf66b55830 tempest-CinderUnicodeTest-55399551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c.9221ab2d-94a0-4c3c-8295-919463856516 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:09 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c.9221ab2d-94a0-4c3c-8295-919463856516 Sep 21 12:06:09 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:09 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1d05d3dd-1688-483e-aba2-0dcf66b55830 tempest-CinderUnicodeTest-55399551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c.9221ab2d-94a0-4c3c-8295-919463856516" returned: 0 in 0.250s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1d05d3dd-1688-483e-aba2-0dcf66b55830 tempest-CinderUnicodeTest-55399551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:09 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c.info Sep 21 12:06:09 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:09 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1d05d3dd-1688-483e-aba2-0dcf66b55830 tempest-CinderUnicodeTest-55399551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c.info" returned: 0 in 0.263s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:09 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-1d05d3dd-1688-483e-aba2-0dcf66b55830 tempest-CinderUnicodeTest-55399551 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c.info is being set with open permissions: ugo+rw Sep 21 12:06:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1d05d3dd-1688-483e-aba2-0dcf66b55830 tempest-CinderUnicodeTest-55399551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:09 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c.info Sep 21 12:06:09 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:09 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1d05d3dd-1688-483e-aba2-0dcf66b55830 tempest-CinderUnicodeTest-55399551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c.info" returned: 0 in 0.259s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1d05d3dd-1688-483e-aba2-0dcf66b55830 tempest-CinderUnicodeTest-55399551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.961s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a82ca235-1d98-4dfa-a884-2f4563920ef2 tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.247s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-a82ca235-1d98-4dfa-a884-2f4563920ef2 tempest-VolumesSnapshotListTestJSON-1550961070 None] Creating offline snapshot 66d364d6-1a65-4fcc-819c-b64f9f298695 of volume 789b41f2-6470-4d10-b0c9-1254ea0460d2 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:06:09 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1d05d3dd-1688-483e-aba2-0dcf66b55830 tempest-CinderUnicodeTest-55399551 None] Create snapshot completed successfully Sep 21 12:06:09 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e417038-0641-40f1-9453-db7b0de700a7]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:06:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a82ca235-1d98-4dfa-a884-2f4563920ef2 tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:10 devstack sudo[101108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb Sep 21 12:06:10 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:10 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a82ca235-1d98-4dfa-a884-2f4563920ef2 tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb" returned: 0 in 0.390s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:10 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-a82ca235-1d98-4dfa-a884-2f4563920ef2 tempest-VolumesSnapshotListTestJSON-1550961070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-789b41f2-6470-4d10-b0c9-1254ea0460d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:06:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a82ca235-1d98-4dfa-a884-2f4563920ef2 tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:10 devstack sudo[101113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695 1G Sep 21 12:06:10 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:10 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-507a90a3-0398-4d80-80b3-bd08b3951780 tempest-CinderUnicodeTest-55399551 None] Acquiring lock "cinder-9221ab2d-94a0-4c3c-8295-919463856516-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:06:10 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-507a90a3-0398-4d80-80b3-bd08b3951780 tempest-CinderUnicodeTest-55399551 None] Lock "cinder-9221ab2d-94a0-4c3c-8295-919463856516-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:06:10 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-507a90a3-0398-4d80-80b3-bd08b3951780 tempest-CinderUnicodeTest-55399551 None] Acquiring lock "cinder-quobyte-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:06:10 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-507a90a3-0398-4d80-80b3-bd08b3951780 tempest-CinderUnicodeTest-55399551 None] Lock "cinder-quobyte-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:06:10 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-507a90a3-0398-4d80-80b3-bd08b3951780 tempest-CinderUnicodeTest-55399551 None] Acquiring lock "cinder-quobyte-9221ab2d-94a0-4c3c-8295-919463856516" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:06:10 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-507a90a3-0398-4d80-80b3-bd08b3951780 tempest-CinderUnicodeTest-55399551 None] Lock "cinder-quobyte-9221ab2d-94a0-4c3c-8295-919463856516" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:06:10 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-507a90a3-0398-4d80-80b3-bd08b3951780 tempest-CinderUnicodeTest-55399551 None] Deleting offline snapshot 9221ab2d-94a0-4c3c-8295-919463856516 of volume ab02b410-2c13-42b2-8bf7-215f4f6a9d7c {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:06:10 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-507a90a3-0398-4d80-80b3-bd08b3951780 tempest-CinderUnicodeTest-55399551 None] snapshot_file for this snap is: volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c.9221ab2d-94a0-4c3c-8295-919463856516 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:06:10 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad677878-efae-414e-91d6-eb379587487c]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:06:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-507a90a3-0398-4d80-80b3-bd08b3951780 tempest-CinderUnicodeTest-55399551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c.9221ab2d-94a0-4c3c-8295-919463856516 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:10 devstack sudo[101117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c.9221ab2d-94a0-4c3c-8295-919463856516 Sep 21 12:06:10 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:10 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a82ca235-1d98-4dfa-a884-2f4563920ef2 tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695 1G" returned: 0 in 0.521s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a82ca235-1d98-4dfa-a884-2f4563920ef2 tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:10 devstack sudo[101121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695 Sep 21 12:06:10 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:11 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-507a90a3-0398-4d80-80b3-bd08b3951780 tempest-CinderUnicodeTest-55399551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c.9221ab2d-94a0-4c3c-8295-919463856516" returned: 0 in 0.431s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:11 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-507a90a3-0398-4d80-80b3-bd08b3951780 tempest-CinderUnicodeTest-55399551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:06:11 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abc73ce-deb7-472f-a707-fd7b96136612]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:06:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-507a90a3-0398-4d80-80b3-bd08b3951780 tempest-CinderUnicodeTest-55399551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:11 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a82ca235-1d98-4dfa-a884-2f4563920ef2 tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695" returned: 0 in 0.315s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:11 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-a82ca235-1d98-4dfa-a884-2f4563920ef2 tempest-VolumesSnapshotListTestJSON-1550961070 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695 is being set with open permissions: ugo+rw Sep 21 12:06:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a82ca235-1d98-4dfa-a884-2f4563920ef2 tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:11 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c Sep 21 12:06:11 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:11 devstack sudo[101130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695 Sep 21 12:06:11 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:11 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a82ca235-1d98-4dfa-a884-2f4563920ef2 tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695" returned: 0 in 0.248s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a82ca235-1d98-4dfa-a884-2f4563920ef2 tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.586s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:11 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-a82ca235-1d98-4dfa-a884-2f4563920ef2 tempest-VolumesSnapshotListTestJSON-1550961070 None] Create snapshot completed successfully Sep 21 12:06:11 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-507a90a3-0398-4d80-80b3-bd08b3951780 tempest-CinderUnicodeTest-55399551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c" returned: 0 in 0.416s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-507a90a3-0398-4d80-80b3-bd08b3951780 tempest-CinderUnicodeTest-55399551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c.9221ab2d-94a0-4c3c-8295-919463856516 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:11 devstack sudo[101137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c.9221ab2d-94a0-4c3c-8295-919463856516 Sep 21 12:06:11 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:11 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-507a90a3-0398-4d80-80b3-bd08b3951780 tempest-CinderUnicodeTest-55399551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c.9221ab2d-94a0-4c3c-8295-919463856516" returned: 0 in 0.441s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-507a90a3-0398-4d80-80b3-bd08b3951780 tempest-CinderUnicodeTest-55399551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c.9221ab2d-94a0-4c3c-8295-919463856516 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:12 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c.9221ab2d-94a0-4c3c-8295-919463856516 Sep 21 12:06:12 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4365020b-614a-47a4-8473-f8dd19874259 tempest-VolumesSnapshotListTestJSON-1550961070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4365020b-614a-47a4-8473-f8dd19874259 tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:12 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-4365020b-614a-47a4-8473-f8dd19874259 tempest-VolumesSnapshotListTestJSON-1550961070 None] Creating offline snapshot a40cb853-2ea3-4627-96f9-f58afc2774bc of volume 789b41f2-6470-4d10-b0c9-1254ea0460d2 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:06:12 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b3f867-44ef-4ebe-b2cb-72f3b5c2c822]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:06:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4365020b-614a-47a4-8473-f8dd19874259 tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:12 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695 Sep 21 12:06:12 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:12 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-507a90a3-0398-4d80-80b3-bd08b3951780 tempest-CinderUnicodeTest-55399551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c.9221ab2d-94a0-4c3c-8295-919463856516" returned: 0 in 0.285s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-507a90a3-0398-4d80-80b3-bd08b3951780 tempest-CinderUnicodeTest-55399551 None] Lock "cinder-quobyte-9221ab2d-94a0-4c3c-8295-919463856516" released by "_delete_snapshot" :: held 1.694s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-507a90a3-0398-4d80-80b3-bd08b3951780 tempest-CinderUnicodeTest-55399551 None] Lock "cinder-quobyte-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c" released by "delete_snapshot" :: held 1.718s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:12 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-507a90a3-0398-4d80-80b3-bd08b3951780 tempest-CinderUnicodeTest-55399551 None] Created reservations ['4bd784fb-513c-4bd9-a0c8-eb4d174d4dd1', '4a875d1b-4c78-4686-afc9-f650d675c96e', '0e7b56b2-84bc-48e3-8567-d3c02e334359', '1191f9ee-25d5-4d17-acd0-8aa35a8dccb5'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:06:12 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-507a90a3-0398-4d80-80b3-bd08b3951780 tempest-CinderUnicodeTest-55399551 None] Delete snapshot completed successfully. Sep 21 12:06:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-507a90a3-0398-4d80-80b3-bd08b3951780 tempest-CinderUnicodeTest-55399551 None] Lock "cinder-9221ab2d-94a0-4c3c-8295-919463856516-delete_snapshot" released by "delete_snapshot" :: held 1.875s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:12 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4365020b-614a-47a4-8473-f8dd19874259 tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695" returned: 0 in 0.407s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:12 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-4365020b-614a-47a4-8473-f8dd19874259 tempest-VolumesSnapshotListTestJSON-1550961070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-789b41f2-6470-4d10-b0c9-1254ea0460d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:06:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4365020b-614a-47a4-8473-f8dd19874259 tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.a40cb853-2ea3-4627-96f9-f58afc2774bc 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:12 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.a40cb853-2ea3-4627-96f9-f58afc2774bc 1G Sep 21 12:06:12 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4ac3fe28-f362-4122-bf2c-a6176979ced0 tempest-CinderUnicodeTest-55399551 None] Acquiring lock "cinder-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:06:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4ac3fe28-f362-4122-bf2c-a6176979ced0 tempest-CinderUnicodeTest-55399551 None] Lock "cinder-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:06:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4ac3fe28-f362-4122-bf2c-a6176979ced0 tempest-CinderUnicodeTest-55399551 None] Acquiring lock "cinder-quobyte-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:06:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4ac3fe28-f362-4122-bf2c-a6176979ced0 tempest-CinderUnicodeTest-55399551 None] Lock "cinder-quobyte-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c" acquired by "delete_volume" :: waited 0.019s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:06:12 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[810ccd03-d618-4ccb-a78b-218f82326ea7]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:06:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4ac3fe28-f362-4122-bf2c-a6176979ced0 tempest-CinderUnicodeTest-55399551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:12 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c Sep 21 12:06:12 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:13 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4365020b-614a-47a4-8473-f8dd19874259 tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.a40cb853-2ea3-4627-96f9-f58afc2774bc 1G" returned: 0 in 0.506s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4365020b-614a-47a4-8473-f8dd19874259 tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.a40cb853-2ea3-4627-96f9-f58afc2774bc {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:13 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.a40cb853-2ea3-4627-96f9-f58afc2774bc Sep 21 12:06:13 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:13 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4ac3fe28-f362-4122-bf2c-a6176979ced0 tempest-CinderUnicodeTest-55399551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c" returned: 0 in 0.389s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4ac3fe28-f362-4122-bf2c-a6176979ced0 tempest-CinderUnicodeTest-55399551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:13 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c Sep 21 12:06:13 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:13 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4365020b-614a-47a4-8473-f8dd19874259 tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.a40cb853-2ea3-4627-96f9-f58afc2774bc" returned: 0 in 0.319s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:13 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-4365020b-614a-47a4-8473-f8dd19874259 tempest-VolumesSnapshotListTestJSON-1550961070 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.a40cb853-2ea3-4627-96f9-f58afc2774bc is being set with open permissions: ugo+rw Sep 21 12:06:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4365020b-614a-47a4-8473-f8dd19874259 tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.a40cb853-2ea3-4627-96f9-f58afc2774bc {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:13 devstack sudo[101169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.a40cb853-2ea3-4627-96f9-f58afc2774bc Sep 21 12:06:13 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:13 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4ac3fe28-f362-4122-bf2c-a6176979ced0 tempest-CinderUnicodeTest-55399551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c" returned: 0 in 0.274s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:13 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4ac3fe28-f362-4122-bf2c-a6176979ced0 tempest-CinderUnicodeTest-55399551 None] Lock "cinder-quobyte-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c" released by "delete_volume" :: held 0.739s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:13 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-4ac3fe28-f362-4122-bf2c-a6176979ced0 tempest-CinderUnicodeTest-55399551 None] Created reservations ['7c619423-ef2c-4a90-a6b2-c531799b8314', '6e1fcd11-c544-4d54-8ff7-c6e3c27a32ad', 'a03f380c-2d6e-4756-9034-f5c959f58022', '42bada45-c8e1-4b6d-93f0-5449a0f1af23'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:06:13 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4365020b-614a-47a4-8473-f8dd19874259 tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.a40cb853-2ea3-4627-96f9-f58afc2774bc" returned: 0 in 0.262s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4365020b-614a-47a4-8473-f8dd19874259 tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.612s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:13 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-4365020b-614a-47a4-8473-f8dd19874259 tempest-VolumesSnapshotListTestJSON-1550961070 None] Create snapshot completed successfully Sep 21 12:06:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4ac3fe28-f362-4122-bf2c-a6176979ced0 tempest-CinderUnicodeTest-55399551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4ac3fe28-f362-4122-bf2c-a6176979ced0 tempest-CinderUnicodeTest-55399551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:13 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4ac3fe28-f362-4122-bf2c-a6176979ced0 tempest-CinderUnicodeTest-55399551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:06:13 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4ac3fe28-f362-4122-bf2c-a6176979ced0 tempest-CinderUnicodeTest-55399551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:06:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4ac3fe28-f362-4122-bf2c-a6176979ced0 tempest-CinderUnicodeTest-55399551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4ac3fe28-f362-4122-bf2c-a6176979ced0 tempest-CinderUnicodeTest-55399551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:13 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:06:13 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:13 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c9399f58-5233-4a27-81b7-c1616109f6a1 tempest-CinderUnicodeTest-55399551 None] Acquiring lock "cinder-13478588-b725-42f1-8b24-b6a5cb13ccde-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:06:13 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c9399f58-5233-4a27-81b7-c1616109f6a1 tempest-CinderUnicodeTest-55399551 None] Lock "cinder-13478588-b725-42f1-8b24-b6a5cb13ccde-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:06:13 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c9399f58-5233-4a27-81b7-c1616109f6a1 tempest-CinderUnicodeTest-55399551 None] Acquiring lock "cinder-quobyte-13478588-b725-42f1-8b24-b6a5cb13ccde" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:06:13 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c9399f58-5233-4a27-81b7-c1616109f6a1 tempest-CinderUnicodeTest-55399551 None] Lock "cinder-quobyte-13478588-b725-42f1-8b24-b6a5cb13ccde" acquired by "delete_volume" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:06:14 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d6a821-4d14-4d8d-843b-2f86d493ccec]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:06:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c9399f58-5233-4a27-81b7-c1616109f6a1 tempest-CinderUnicodeTest-55399551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-13478588-b725-42f1-8b24-b6a5cb13ccde {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:14 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4ac3fe28-f362-4122-bf2c-a6176979ced0 tempest-CinderUnicodeTest-55399551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.312s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:14 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-4ac3fe28-f362-4122-bf2c-a6176979ced0 tempest-CinderUnicodeTest-55399551 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:06:14 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-4ac3fe28-f362-4122-bf2c-a6176979ced0 tempest-CinderUnicodeTest-55399551 None] Deleted volume successfully. Sep 21 12:06:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4ac3fe28-f362-4122-bf2c-a6176979ced0 tempest-CinderUnicodeTest-55399551 None] Lock "cinder-ab02b410-2c13-42b2-8bf7-215f4f6a9d7c-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:14 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-13478588-b725-42f1-8b24-b6a5cb13ccde Sep 21 12:06:14 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:14 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c9399f58-5233-4a27-81b7-c1616109f6a1 tempest-CinderUnicodeTest-55399551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-13478588-b725-42f1-8b24-b6a5cb13ccde" returned: 0 in 0.480s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c9399f58-5233-4a27-81b7-c1616109f6a1 tempest-CinderUnicodeTest-55399551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-13478588-b725-42f1-8b24-b6a5cb13ccde {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:14 devstack sudo[101181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-13478588-b725-42f1-8b24-b6a5cb13ccde Sep 21 12:06:14 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:14 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c9399f58-5233-4a27-81b7-c1616109f6a1 tempest-CinderUnicodeTest-55399551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-13478588-b725-42f1-8b24-b6a5cb13ccde" returned: 0 in 0.285s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c9399f58-5233-4a27-81b7-c1616109f6a1 tempest-CinderUnicodeTest-55399551 None] Lock "cinder-quobyte-13478588-b725-42f1-8b24-b6a5cb13ccde" released by "delete_volume" :: held 0.829s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:14 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-c9399f58-5233-4a27-81b7-c1616109f6a1 tempest-CinderUnicodeTest-55399551 None] Created reservations ['dd722234-acdc-4aba-9ac6-3c706cc3fab7', 'b276d5fd-a36e-42fd-afdd-4c210856de9d', '29e19c86-a8b4-4384-af03-23dd2aa93e4a', 'fd04161c-fdd9-450c-8ec7-3038b106559e'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:06:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c9399f58-5233-4a27-81b7-c1616109f6a1 tempest-CinderUnicodeTest-55399551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c9399f58-5233-4a27-81b7-c1616109f6a1 tempest-CinderUnicodeTest-55399551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:14 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c9399f58-5233-4a27-81b7-c1616109f6a1 tempest-CinderUnicodeTest-55399551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:06:15 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c9399f58-5233-4a27-81b7-c1616109f6a1 tempest-CinderUnicodeTest-55399551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:06:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c9399f58-5233-4a27-81b7-c1616109f6a1 tempest-CinderUnicodeTest-55399551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c9399f58-5233-4a27-81b7-c1616109f6a1 tempest-CinderUnicodeTest-55399551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:15 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:06:15 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:15 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-71a67cd5-fc1d-4148-bae5-c5b5a2194102 tempest-VolumesSnapshotListTestJSON-1550961070 None] Acquiring lock "cinder-a40cb853-2ea3-4627-96f9-f58afc2774bc-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:06:15 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-71a67cd5-fc1d-4148-bae5-c5b5a2194102 tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "cinder-a40cb853-2ea3-4627-96f9-f58afc2774bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:06:15 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-71a67cd5-fc1d-4148-bae5-c5b5a2194102 tempest-VolumesSnapshotListTestJSON-1550961070 None] Acquiring lock "cinder-quobyte-789b41f2-6470-4d10-b0c9-1254ea0460d2" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:06:15 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-71a67cd5-fc1d-4148-bae5-c5b5a2194102 tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "cinder-quobyte-789b41f2-6470-4d10-b0c9-1254ea0460d2" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:06:15 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-71a67cd5-fc1d-4148-bae5-c5b5a2194102 tempest-VolumesSnapshotListTestJSON-1550961070 None] Acquiring lock "cinder-quobyte-a40cb853-2ea3-4627-96f9-f58afc2774bc" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:06:15 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-71a67cd5-fc1d-4148-bae5-c5b5a2194102 tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "cinder-quobyte-a40cb853-2ea3-4627-96f9-f58afc2774bc" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:06:15 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-71a67cd5-fc1d-4148-bae5-c5b5a2194102 tempest-VolumesSnapshotListTestJSON-1550961070 None] Deleting offline snapshot a40cb853-2ea3-4627-96f9-f58afc2774bc of volume 789b41f2-6470-4d10-b0c9-1254ea0460d2 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:06:15 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-71a67cd5-fc1d-4148-bae5-c5b5a2194102 tempest-VolumesSnapshotListTestJSON-1550961070 None] snapshot_file for this snap is: volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.a40cb853-2ea3-4627-96f9-f58afc2774bc {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:06:15 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[7145b1c2-7799-4dbc-9b85-345d13582d48]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:06:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-71a67cd5-fc1d-4148-bae5-c5b5a2194102 tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.a40cb853-2ea3-4627-96f9-f58afc2774bc {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:15 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c9399f58-5233-4a27-81b7-c1616109f6a1 tempest-CinderUnicodeTest-55399551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.337s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:15 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-c9399f58-5233-4a27-81b7-c1616109f6a1 tempest-CinderUnicodeTest-55399551 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:06:15 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-c9399f58-5233-4a27-81b7-c1616109f6a1 tempest-CinderUnicodeTest-55399551 None] Deleted volume successfully. Sep 21 12:06:15 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c9399f58-5233-4a27-81b7-c1616109f6a1 tempest-CinderUnicodeTest-55399551 None] Lock "cinder-13478588-b725-42f1-8b24-b6a5cb13ccde-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:15 devstack sudo[101187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.a40cb853-2ea3-4627-96f9-f58afc2774bc Sep 21 12:06:15 devstack sudo[101187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:15 devstack sudo[101187]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-71a67cd5-fc1d-4148-bae5-c5b5a2194102 tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.a40cb853-2ea3-4627-96f9-f58afc2774bc" returned: 0 in 0.487s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:15 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-71a67cd5-fc1d-4148-bae5-c5b5a2194102 tempest-VolumesSnapshotListTestJSON-1550961070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-789b41f2-6470-4d10-b0c9-1254ea0460d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:06:15 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aba7471-f72c-4ea2-a1c6-cc42476e1b28]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:06:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-71a67cd5-fc1d-4148-bae5-c5b5a2194102 tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:15 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695 Sep 21 12:06:15 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:16 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-71a67cd5-fc1d-4148-bae5-c5b5a2194102 tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695" returned: 0 in 0.475s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-71a67cd5-fc1d-4148-bae5-c5b5a2194102 tempest-VolumesSnapshotListTestJSON-1550961070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-789b41f2-6470-4d10-b0c9-1254ea0460d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:06:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-71a67cd5-fc1d-4148-bae5-c5b5a2194102 tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.a40cb853-2ea3-4627-96f9-f58afc2774bc {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:16 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.a40cb853-2ea3-4627-96f9-f58afc2774bc Sep 21 12:06:16 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:16 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-71a67cd5-fc1d-4148-bae5-c5b5a2194102 tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.a40cb853-2ea3-4627-96f9-f58afc2774bc" returned: 0 in 0.481s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-71a67cd5-fc1d-4148-bae5-c5b5a2194102 tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.a40cb853-2ea3-4627-96f9-f58afc2774bc {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:16 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.a40cb853-2ea3-4627-96f9-f58afc2774bc Sep 21 12:06:16 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:17 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-71a67cd5-fc1d-4148-bae5-c5b5a2194102 tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.a40cb853-2ea3-4627-96f9-f58afc2774bc" returned: 0 in 0.274s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-71a67cd5-fc1d-4148-bae5-c5b5a2194102 tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "cinder-quobyte-a40cb853-2ea3-4627-96f9-f58afc2774bc" released by "_delete_snapshot" :: held 1.848s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-71a67cd5-fc1d-4148-bae5-c5b5a2194102 tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "cinder-quobyte-789b41f2-6470-4d10-b0c9-1254ea0460d2" released by "delete_snapshot" :: held 1.883s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:17 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-71a67cd5-fc1d-4148-bae5-c5b5a2194102 tempest-VolumesSnapshotListTestJSON-1550961070 None] Created reservations ['e673c8b0-2232-4de3-9eb0-e18c0d895782', 'dced51b6-df48-409a-bc99-6c443cb0a4bd', '7ee944cf-b2d8-4d3d-b5b6-9d59e8dde20d', '53431000-14ff-4cde-8e4c-828c54df90c8'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:06:17 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-71a67cd5-fc1d-4148-bae5-c5b5a2194102 tempest-VolumesSnapshotListTestJSON-1550961070 None] Delete snapshot completed successfully. Sep 21 12:06:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-71a67cd5-fc1d-4148-bae5-c5b5a2194102 tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "cinder-a40cb853-2ea3-4627-96f9-f58afc2774bc-delete_snapshot" released by "delete_snapshot" :: held 2.057s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a3049f41-a27b-46a8-9b7c-289679ee37ea tempest-VolumesSnapshotListTestJSON-1550961070 None] Acquiring lock "cinder-66d364d6-1a65-4fcc-819c-b64f9f298695-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:06:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a3049f41-a27b-46a8-9b7c-289679ee37ea tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "cinder-66d364d6-1a65-4fcc-819c-b64f9f298695-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:06:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a3049f41-a27b-46a8-9b7c-289679ee37ea tempest-VolumesSnapshotListTestJSON-1550961070 None] Acquiring lock "cinder-quobyte-789b41f2-6470-4d10-b0c9-1254ea0460d2" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:06:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a3049f41-a27b-46a8-9b7c-289679ee37ea tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "cinder-quobyte-789b41f2-6470-4d10-b0c9-1254ea0460d2" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:06:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a3049f41-a27b-46a8-9b7c-289679ee37ea tempest-VolumesSnapshotListTestJSON-1550961070 None] Acquiring lock "cinder-quobyte-66d364d6-1a65-4fcc-819c-b64f9f298695" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:06:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a3049f41-a27b-46a8-9b7c-289679ee37ea tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "cinder-quobyte-66d364d6-1a65-4fcc-819c-b64f9f298695" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:06:17 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-a3049f41-a27b-46a8-9b7c-289679ee37ea tempest-VolumesSnapshotListTestJSON-1550961070 None] Deleting offline snapshot 66d364d6-1a65-4fcc-819c-b64f9f298695 of volume 789b41f2-6470-4d10-b0c9-1254ea0460d2 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:06:17 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-a3049f41-a27b-46a8-9b7c-289679ee37ea tempest-VolumesSnapshotListTestJSON-1550961070 None] snapshot_file for this snap is: volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:06:17 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cb53a9-410b-4290-a33e-656a9e4d4259]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:06:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a3049f41-a27b-46a8-9b7c-289679ee37ea tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:17 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695 Sep 21 12:06:17 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:17 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a3049f41-a27b-46a8-9b7c-289679ee37ea tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695" returned: 0 in 0.429s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:17 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-a3049f41-a27b-46a8-9b7c-289679ee37ea tempest-VolumesSnapshotListTestJSON-1550961070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-789b41f2-6470-4d10-b0c9-1254ea0460d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:06:17 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbce9a0-482d-44b5-a1fe-5e41c854cbf6]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:06:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a3049f41-a27b-46a8-9b7c-289679ee37ea tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:18 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb Sep 21 12:06:18 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:18 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a3049f41-a27b-46a8-9b7c-289679ee37ea tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb" returned: 0 in 0.400s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:18 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-a3049f41-a27b-46a8-9b7c-289679ee37ea tempest-VolumesSnapshotListTestJSON-1550961070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-789b41f2-6470-4d10-b0c9-1254ea0460d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:06:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a3049f41-a27b-46a8-9b7c-289679ee37ea tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:18 devstack sudo[101217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695 Sep 21 12:06:18 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:18 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a3049f41-a27b-46a8-9b7c-289679ee37ea tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695" returned: 0 in 0.427s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a3049f41-a27b-46a8-9b7c-289679ee37ea tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:18 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695 Sep 21 12:06:18 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:19 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a3049f41-a27b-46a8-9b7c-289679ee37ea tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.66d364d6-1a65-4fcc-819c-b64f9f298695" returned: 0 in 0.295s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a3049f41-a27b-46a8-9b7c-289679ee37ea tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "cinder-quobyte-66d364d6-1a65-4fcc-819c-b64f9f298695" released by "_delete_snapshot" :: held 1.682s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a3049f41-a27b-46a8-9b7c-289679ee37ea tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "cinder-quobyte-789b41f2-6470-4d10-b0c9-1254ea0460d2" released by "delete_snapshot" :: held 1.713s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:19 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-a3049f41-a27b-46a8-9b7c-289679ee37ea tempest-VolumesSnapshotListTestJSON-1550961070 None] Created reservations ['1af9b0ad-bb86-41c2-99ee-68e935bd836b', '7dea904e-cf75-4dab-8f80-bd6fef00f7e8', '1d9d9300-9705-4547-8ab8-2314e47daa2b', '9dd07651-4fa0-47ec-b0cc-bef0e95175f4'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:06:19 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-a3049f41-a27b-46a8-9b7c-289679ee37ea tempest-VolumesSnapshotListTestJSON-1550961070 None] Delete snapshot completed successfully. Sep 21 12:06:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a3049f41-a27b-46a8-9b7c-289679ee37ea tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "cinder-66d364d6-1a65-4fcc-819c-b64f9f298695-delete_snapshot" released by "delete_snapshot" :: held 1.940s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-58c56a85-b392-48f6-9385-05123829d02e tempest-VolumesSnapshotListTestJSON-1550961070 None] Acquiring lock "cinder-686a4e0d-e4d9-4a2b-b2e1-40e78c729abb-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:06:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-58c56a85-b392-48f6-9385-05123829d02e tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "cinder-686a4e0d-e4d9-4a2b-b2e1-40e78c729abb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:06:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-58c56a85-b392-48f6-9385-05123829d02e tempest-VolumesSnapshotListTestJSON-1550961070 None] Acquiring lock "cinder-quobyte-789b41f2-6470-4d10-b0c9-1254ea0460d2" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:06:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-58c56a85-b392-48f6-9385-05123829d02e tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "cinder-quobyte-789b41f2-6470-4d10-b0c9-1254ea0460d2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:06:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-58c56a85-b392-48f6-9385-05123829d02e tempest-VolumesSnapshotListTestJSON-1550961070 None] Acquiring lock "cinder-quobyte-686a4e0d-e4d9-4a2b-b2e1-40e78c729abb" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:06:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-58c56a85-b392-48f6-9385-05123829d02e tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "cinder-quobyte-686a4e0d-e4d9-4a2b-b2e1-40e78c729abb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:06:19 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-58c56a85-b392-48f6-9385-05123829d02e tempest-VolumesSnapshotListTestJSON-1550961070 None] Deleting offline snapshot 686a4e0d-e4d9-4a2b-b2e1-40e78c729abb of volume 789b41f2-6470-4d10-b0c9-1254ea0460d2 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:06:19 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-58c56a85-b392-48f6-9385-05123829d02e tempest-VolumesSnapshotListTestJSON-1550961070 None] snapshot_file for this snap is: volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:06:19 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed12fe2-8829-468b-98e7-3aa4e06a132a]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:06:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-58c56a85-b392-48f6-9385-05123829d02e tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:19 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb Sep 21 12:06:19 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:20 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-58c56a85-b392-48f6-9385-05123829d02e tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb" returned: 0 in 0.461s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-58c56a85-b392-48f6-9385-05123829d02e tempest-VolumesSnapshotListTestJSON-1550961070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-789b41f2-6470-4d10-b0c9-1254ea0460d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:06:20 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee10237-f8ff-4205-9098-8ad6d33788dc]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:06:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-58c56a85-b392-48f6-9385-05123829d02e tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-37fc2bdd-a43c-42ba-8662-f44cd8150310 req-71892892-2d8e-4243-bc85-9feed3a971b1 tempest-TestStampPattern-1856543467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-37fc2bdd-a43c-42ba-8662-f44cd8150310 req-71892892-2d8e-4243-bc85-9feed3a971b1 tempest-TestStampPattern-1856543467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-37fc2bdd-a43c-42ba-8662-f44cd8150310 req-71892892-2d8e-4243-bc85-9feed3a971b1 tempest-TestStampPattern-1856543467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-37fc2bdd-a43c-42ba-8662-f44cd8150310 req-71892892-2d8e-4243-bc85-9feed3a971b1 tempest-TestStampPattern-1856543467 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d', 'name': 'volume-241e3e59-081b-4241-b3de-75aafd49db55', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'afe7e315-e417-4545-acc7-34233845beee', 'enforce_multipath': True} {{(pid=86366) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 12:06:20 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2 Sep 21 12:06:20 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:20 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-37fc2bdd-a43c-42ba-8662-f44cd8150310 req-71892892-2d8e-4243-bc85-9feed3a971b1 tempest-TestStampPattern-1856543467 None] attachment_update completed successfully. Sep 21 12:06:20 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-58c56a85-b392-48f6-9385-05123829d02e tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2" returned: 0 in 0.407s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-58c56a85-b392-48f6-9385-05123829d02e tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:20 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb Sep 21 12:06:20 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:21 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-58c56a85-b392-48f6-9385-05123829d02e tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb" returned: 0 in 0.527s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-58c56a85-b392-48f6-9385-05123829d02e tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:21 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb Sep 21 12:06:21 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:21 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-58c56a85-b392-48f6-9385-05123829d02e tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2.686a4e0d-e4d9-4a2b-b2e1-40e78c729abb" returned: 0 in 0.276s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-58c56a85-b392-48f6-9385-05123829d02e tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "cinder-quobyte-686a4e0d-e4d9-4a2b-b2e1-40e78c729abb" released by "_delete_snapshot" :: held 1.817s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-58c56a85-b392-48f6-9385-05123829d02e tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "cinder-quobyte-789b41f2-6470-4d10-b0c9-1254ea0460d2" released by "delete_snapshot" :: held 1.843s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:21 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-58c56a85-b392-48f6-9385-05123829d02e tempest-VolumesSnapshotListTestJSON-1550961070 None] Created reservations ['ad140518-61a8-488c-aeb4-b231b29bc725', 'c304f596-f4dd-49f9-8fc3-9942cc974a68', '49cbd98e-761a-4bf7-babc-ea58795d30b3', '327542c8-62df-498b-bce8-751810e68b1f'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:06:21 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-58c56a85-b392-48f6-9385-05123829d02e tempest-VolumesSnapshotListTestJSON-1550961070 None] Delete snapshot completed successfully. Sep 21 12:06:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-58c56a85-b392-48f6-9385-05123829d02e tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "cinder-686a4e0d-e4d9-4a2b-b2e1-40e78c729abb-delete_snapshot" released by "delete_snapshot" :: held 1.988s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b600fa2f-b554-4d97-94fc-7fa6875285cb tempest-VolumesSnapshotListTestJSON-1550961070 None] Acquiring lock "cinder-789b41f2-6470-4d10-b0c9-1254ea0460d2-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:06:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b600fa2f-b554-4d97-94fc-7fa6875285cb tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "cinder-789b41f2-6470-4d10-b0c9-1254ea0460d2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:06:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b600fa2f-b554-4d97-94fc-7fa6875285cb tempest-VolumesSnapshotListTestJSON-1550961070 None] Acquiring lock "cinder-quobyte-789b41f2-6470-4d10-b0c9-1254ea0460d2" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:06:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b600fa2f-b554-4d97-94fc-7fa6875285cb tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "cinder-quobyte-789b41f2-6470-4d10-b0c9-1254ea0460d2" acquired by "delete_volume" :: waited 0.017s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:06:21 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00a4a0d-b2f7-4e47-ab79-80470bc59218]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:06:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b600fa2f-b554-4d97-94fc-7fa6875285cb tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:22 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2 Sep 21 12:06:22 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:22 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b600fa2f-b554-4d97-94fc-7fa6875285cb tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2" returned: 0 in 0.408s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b600fa2f-b554-4d97-94fc-7fa6875285cb tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:22 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2 Sep 21 12:06:22 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:22 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b600fa2f-b554-4d97-94fc-7fa6875285cb tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-789b41f2-6470-4d10-b0c9-1254ea0460d2" returned: 0 in 0.253s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:22 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b600fa2f-b554-4d97-94fc-7fa6875285cb tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "cinder-quobyte-789b41f2-6470-4d10-b0c9-1254ea0460d2" released by "delete_volume" :: held 0.731s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:22 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-b600fa2f-b554-4d97-94fc-7fa6875285cb tempest-VolumesSnapshotListTestJSON-1550961070 None] Created reservations ['04479d3c-873d-4ec7-9cbe-44be15abefba', '6a9d83d0-d55f-4739-9d6a-b4625d003c4e', '51edea46-4f9a-4e9e-ba40-0717262fb816', '31723e36-e899-4685-ae03-f6123bacf56a'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:06:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b600fa2f-b554-4d97-94fc-7fa6875285cb tempest-VolumesSnapshotListTestJSON-1550961070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b600fa2f-b554-4d97-94fc-7fa6875285cb tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b600fa2f-b554-4d97-94fc-7fa6875285cb tempest-VolumesSnapshotListTestJSON-1550961070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:06:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b600fa2f-b554-4d97-94fc-7fa6875285cb tempest-VolumesSnapshotListTestJSON-1550961070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:06:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b600fa2f-b554-4d97-94fc-7fa6875285cb tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b600fa2f-b554-4d97-94fc-7fa6875285cb tempest-VolumesSnapshotListTestJSON-1550961070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:22 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:06:22 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:23 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b600fa2f-b554-4d97-94fc-7fa6875285cb tempest-VolumesSnapshotListTestJSON-1550961070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.268s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:23 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-b600fa2f-b554-4d97-94fc-7fa6875285cb tempest-VolumesSnapshotListTestJSON-1550961070 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:06:23 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-b600fa2f-b554-4d97-94fc-7fa6875285cb tempest-VolumesSnapshotListTestJSON-1550961070 None] Deleted volume successfully. Sep 21 12:06:23 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b600fa2f-b554-4d97-94fc-7fa6875285cb tempest-VolumesSnapshotListTestJSON-1550961070 None] Lock "cinder-789b41f2-6470-4d10-b0c9-1254ea0460d2-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:24 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:06:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Flow 'volume_create_manager' (6c8d09c9-1251-4aa1-93ed-9a08dc339072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:06:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec8c015-7589-4503-96fd-60a22bfd7e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec8c015-7589-4503-96fd-60a22bfd7e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1506024075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=633b7aac-62cc-4381-8f3e-576615f510d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b516002f094dbbba096e6c881203e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:06:24Z,use_quota=True,user_id='82cf50c5370b440497281f778ab2531f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df112973-d592-4748-9fa9-c78df9d9c6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df112973-d592-4748-9fa9-c78df9d9c6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80325576-a0e3-4272-b8f6-675c3d9cb670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80325576-a0e3-4272-b8f6-675c3d9cb670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '633b7aac-62cc-4381-8f3e-576615f510d5', 'volume_name': 'volume-633b7aac-62cc-4381-8f3e-576615f510d5', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37fdbbaa-56c7-4761-aed7-b4c58e26f73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37fdbbaa-56c7-4761-aed7-b4c58e26f73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d67cbbde-2b00-45d5-b802-ba8b92bc6860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:24 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Volume 633b7aac-62cc-4381-8f3e-576615f510d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-633b7aac-62cc-4381-8f3e-576615f510d5', 'volume_size': 1} Sep 21 12:06:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:24 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1506024075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=633b7aac-62cc-4381-8f3e-576615f510d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b516002f094dbbba096e6c881203e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:06:24Z,use_quota=True,user_id='82cf50c5370b440497281f778ab2531f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:06:24 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Creating volume 633b7aac-62cc-4381-8f3e-576615f510d5 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:06:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:24 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:06:24 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:06:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:24 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:06:24 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:06:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-633b7aac-62cc-4381-8f3e-576615f510d5 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:24 devstack sudo[101697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-633b7aac-62cc-4381-8f3e-576615f510d5 1073741824 Sep 21 12:06:24 devstack sudo[101697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:24 devstack sudo[101697]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-633b7aac-62cc-4381-8f3e-576615f510d5 1073741824" returned: 0 in 0.536s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-633b7aac-62cc-4381-8f3e-576615f510d5 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:24 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-633b7aac-62cc-4381-8f3e-576615f510d5 Sep 21 12:06:24 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:25 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-633b7aac-62cc-4381-8f3e-576615f510d5" returned: 0 in 0.308s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:25 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:06:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d67cbbde-2b00-45d5-b802-ba8b92bc6860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-633b7aac-62cc-4381-8f3e-576615f510d5', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd748c75-b83f-48fa-a604-dcc0c9801fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:25 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Volume volume-633b7aac-62cc-4381-8f3e-576615f510d5 (633b7aac-62cc-4381-8f3e-576615f510d5): created successfully Sep 21 12:06:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd748c75-b83f-48fa-a604-dcc0c9801fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Flow 'volume_create_manager' (6c8d09c9-1251-4aa1-93ed-9a08dc339072) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:06:25 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-9fd32ea2-f8fa-408c-957a-77f8c86ba918 tempest-ProjectReaderTests-1134609247 None] Created volume successfully. Sep 21 12:06:26 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-c3f2fcbd-56d5-4af0-a399-8dc71ee41cd6 req-49b7d137-9725-4ef5-bae5-0f14cf960372 tempest-TestStampPattern-1856543467 None] Terminate volume connection completed successfully. Sep 21 12:06:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-c3f2fcbd-56d5-4af0-a399-8dc71ee41cd6 req-49b7d137-9725-4ef5-bae5-0f14cf960372 tempest-TestStampPattern-1856543467 None] Deleting attachment afe7e315-e417-4545-acc7-34233845beee. {{(pid=86366) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 12:06:26 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-67693758-85fc-4591-9c64-2882bc0ff4d8 tempest-ProjectReaderTests-1134609247 None] Acquiring lock "cinder-633b7aac-62cc-4381-8f3e-576615f510d5-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:06:26 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-67693758-85fc-4591-9c64-2882bc0ff4d8 tempest-ProjectReaderTests-1134609247 None] Lock "cinder-633b7aac-62cc-4381-8f3e-576615f510d5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:06:26 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-67693758-85fc-4591-9c64-2882bc0ff4d8 tempest-ProjectReaderTests-1134609247 None] Acquiring lock "cinder-quobyte-633b7aac-62cc-4381-8f3e-576615f510d5" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:06:26 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-67693758-85fc-4591-9c64-2882bc0ff4d8 tempest-ProjectReaderTests-1134609247 None] Lock "cinder-quobyte-633b7aac-62cc-4381-8f3e-576615f510d5" acquired by "delete_volume" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:06:26 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e8251d-2aa8-4e30-b286-41010b08adf2]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:06:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-67693758-85fc-4591-9c64-2882bc0ff4d8 tempest-ProjectReaderTests-1134609247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-633b7aac-62cc-4381-8f3e-576615f510d5 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:26 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-633b7aac-62cc-4381-8f3e-576615f510d5 Sep 21 12:06:26 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:27 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-67693758-85fc-4591-9c64-2882bc0ff4d8 tempest-ProjectReaderTests-1134609247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-633b7aac-62cc-4381-8f3e-576615f510d5" returned: 0 in 0.443s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-67693758-85fc-4591-9c64-2882bc0ff4d8 tempest-ProjectReaderTests-1134609247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-633b7aac-62cc-4381-8f3e-576615f510d5 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c0ec99eb-75f9-4e32-900d-88db01955853 tempest-TestStampPattern-1856543467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c0ec99eb-75f9-4e32-900d-88db01955853 tempest-TestStampPattern-1856543467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:27 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-633b7aac-62cc-4381-8f3e-576615f510d5 Sep 21 12:06:27 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-c0ec99eb-75f9-4e32-900d-88db01955853 tempest-TestStampPattern-1856543467 None] Creating offline snapshot d7981b4b-ad21-4ecc-b2ea-57e475074452 of volume 241e3e59-081b-4241-b3de-75aafd49db55 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:06:27 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[018d82d0-292c-4623-9f43-00003eb017be]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:06:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c0ec99eb-75f9-4e32-900d-88db01955853 tempest-TestStampPattern-1856543467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:27 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55 Sep 21 12:06:27 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:27 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-67693758-85fc-4591-9c64-2882bc0ff4d8 tempest-ProjectReaderTests-1134609247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-633b7aac-62cc-4381-8f3e-576615f510d5" returned: 0 in 0.358s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:27 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-67693758-85fc-4591-9c64-2882bc0ff4d8 tempest-ProjectReaderTests-1134609247 None] Lock "cinder-quobyte-633b7aac-62cc-4381-8f3e-576615f510d5" released by "delete_volume" :: held 0.857s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:27 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-67693758-85fc-4591-9c64-2882bc0ff4d8 tempest-ProjectReaderTests-1134609247 None] Created reservations ['a785abb4-e9b2-4854-9f7e-d2fddc3de9f1', 'f4de34e1-34a1-401a-b67f-dfbb1bd955c7', '33b990ae-48ef-4e38-a650-c35d33396442', '3f84ea30-dcd7-4174-a2ec-26e412f49e7c'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:06:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-67693758-85fc-4591-9c64-2882bc0ff4d8 tempest-ProjectReaderTests-1134609247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-67693758-85fc-4591-9c64-2882bc0ff4d8 tempest-ProjectReaderTests-1134609247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-67693758-85fc-4591-9c64-2882bc0ff4d8 tempest-ProjectReaderTests-1134609247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:06:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-67693758-85fc-4591-9c64-2882bc0ff4d8 tempest-ProjectReaderTests-1134609247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:06:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-67693758-85fc-4591-9c64-2882bc0ff4d8 tempest-ProjectReaderTests-1134609247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-67693758-85fc-4591-9c64-2882bc0ff4d8 tempest-ProjectReaderTests-1134609247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:27 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:06:27 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:27 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c0ec99eb-75f9-4e32-900d-88db01955853 tempest-TestStampPattern-1856543467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55" returned: 0 in 0.518s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c0ec99eb-75f9-4e32-900d-88db01955853 tempest-TestStampPattern-1856543467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.d7981b4b-ad21-4ecc-b2ea-57e475074452 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:27 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.d7981b4b-ad21-4ecc-b2ea-57e475074452 1G Sep 21 12:06:27 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:28 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-67693758-85fc-4591-9c64-2882bc0ff4d8 tempest-ProjectReaderTests-1134609247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.279s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:28 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-67693758-85fc-4591-9c64-2882bc0ff4d8 tempest-ProjectReaderTests-1134609247 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:06:28 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-67693758-85fc-4591-9c64-2882bc0ff4d8 tempest-ProjectReaderTests-1134609247 None] Deleted volume successfully. Sep 21 12:06:28 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-67693758-85fc-4591-9c64-2882bc0ff4d8 tempest-ProjectReaderTests-1134609247 None] Lock "cinder-633b7aac-62cc-4381-8f3e-576615f510d5-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:28 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c0ec99eb-75f9-4e32-900d-88db01955853 tempest-TestStampPattern-1856543467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.d7981b4b-ad21-4ecc-b2ea-57e475074452 1G" returned: 0 in 0.509s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c0ec99eb-75f9-4e32-900d-88db01955853 tempest-TestStampPattern-1856543467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-241e3e59-081b-4241-b3de-75aafd49db55 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.d7981b4b-ad21-4ecc-b2ea-57e475074452 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:28 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-241e3e59-081b-4241-b3de-75aafd49db55 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.d7981b4b-ad21-4ecc-b2ea-57e475074452 Sep 21 12:06:28 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:28 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:06:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Flow 'volume_create_manager' (bd95b1f4-03b1-4733-bd42-32391943ad69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:06:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd3dacac-1ab2-4e40-81ed-bdb7afcf6d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd3dacac-1ab2-4e40-81ed-bdb7afcf6d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-674151891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d032e98-338b-4fa5-89a1-05036e44735b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b516002f094dbbba096e6c881203e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:06:28Z,use_quota=True,user_id='82cf50c5370b440497281f778ab2531f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c66a881-a9f0-42e7-b3f2-d3112a161f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c66a881-a9f0-42e7-b3f2-d3112a161f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa31adca-3824-435a-a73e-ef926d6c054c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa31adca-3824-435a-a73e-ef926d6c054c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d032e98-338b-4fa5-89a1-05036e44735b', 'volume_name': 'volume-9d032e98-338b-4fa5-89a1-05036e44735b', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75acec5a-8db9-4f93-a289-6c3ee1f7ec02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75acec5a-8db9-4f93-a289-6c3ee1f7ec02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb63e01c-437b-4661-bc69-ba419bb2a170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:28 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Volume 9d032e98-338b-4fa5-89a1-05036e44735b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d032e98-338b-4fa5-89a1-05036e44735b', 'volume_size': 1} Sep 21 12:06:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:28 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c0ec99eb-75f9-4e32-900d-88db01955853 tempest-TestStampPattern-1856543467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-241e3e59-081b-4241-b3de-75aafd49db55 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.d7981b4b-ad21-4ecc-b2ea-57e475074452" returned: 0 in 0.332s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:28 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-c0ec99eb-75f9-4e32-900d-88db01955853 tempest-TestStampPattern-1856543467 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.d7981b4b-ad21-4ecc-b2ea-57e475074452 is being set with open permissions: ugo+rw Sep 21 12:06:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c0ec99eb-75f9-4e32-900d-88db01955853 tempest-TestStampPattern-1856543467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.d7981b4b-ad21-4ecc-b2ea-57e475074452 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:28 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.d7981b4b-ad21-4ecc-b2ea-57e475074452 Sep 21 12:06:28 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:28 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c0ec99eb-75f9-4e32-900d-88db01955853 tempest-TestStampPattern-1856543467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.d7981b4b-ad21-4ecc-b2ea-57e475074452" returned: 0 in 0.250s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c0ec99eb-75f9-4e32-900d-88db01955853 tempest-TestStampPattern-1856543467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:28 devstack sudo[101779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.info Sep 21 12:06:28 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:29 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c0ec99eb-75f9-4e32-900d-88db01955853 tempest-TestStampPattern-1856543467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.info" returned: 0 in 0.291s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:29 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-c0ec99eb-75f9-4e32-900d-88db01955853 tempest-TestStampPattern-1856543467 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.info is being set with open permissions: ugo+rw Sep 21 12:06:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c0ec99eb-75f9-4e32-900d-88db01955853 tempest-TestStampPattern-1856543467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:29 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.info Sep 21 12:06:29 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:29 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c0ec99eb-75f9-4e32-900d-88db01955853 tempest-TestStampPattern-1856543467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.info" returned: 0 in 0.301s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c0ec99eb-75f9-4e32-900d-88db01955853 tempest-TestStampPattern-1856543467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.326s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.043s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-674151891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d032e98-338b-4fa5-89a1-05036e44735b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b516002f094dbbba096e6c881203e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:06:28Z,use_quota=True,user_id='82cf50c5370b440497281f778ab2531f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:06:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Creating volume 9d032e98-338b-4fa5-89a1-05036e44735b {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:06:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:06:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:06:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:06:29 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:06:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9d032e98-338b-4fa5-89a1-05036e44735b 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:29 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-c0ec99eb-75f9-4e32-900d-88db01955853 tempest-TestStampPattern-1856543467 None] Create snapshot completed successfully Sep 21 12:06:29 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9d032e98-338b-4fa5-89a1-05036e44735b 1073741824 Sep 21 12:06:29 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:30 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9d032e98-338b-4fa5-89a1-05036e44735b 1073741824" returned: 0 in 0.506s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9d032e98-338b-4fa5-89a1-05036e44735b {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:30 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9d032e98-338b-4fa5-89a1-05036e44735b Sep 21 12:06:30 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:30 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9d032e98-338b-4fa5-89a1-05036e44735b" returned: 0 in 0.288s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:30 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:06:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb63e01c-437b-4661-bc69-ba419bb2a170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d032e98-338b-4fa5-89a1-05036e44735b', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0667ae96-444a-4f4f-8c2d-87a4c92e3f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:30 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Volume volume-9d032e98-338b-4fa5-89a1-05036e44735b (9d032e98-338b-4fa5-89a1-05036e44735b): created successfully Sep 21 12:06:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0667ae96-444a-4f4f-8c2d-87a4c92e3f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Flow 'volume_create_manager' (bd95b1f4-03b1-4733-bd42-32391943ad69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:06:30 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-6f1f3363-2239-4917-bd15-b7711e339469 tempest-ProjectReaderTests-1134609247 None] Created volume successfully. Sep 21 12:06:31 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7dac749e-245e-41ca-b252-03a870931c30 tempest-ProjectReaderTests-1134609247 None] Acquiring lock "cinder-9d032e98-338b-4fa5-89a1-05036e44735b-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:06:31 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7dac749e-245e-41ca-b252-03a870931c30 tempest-ProjectReaderTests-1134609247 None] Lock "cinder-9d032e98-338b-4fa5-89a1-05036e44735b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:06:31 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7dac749e-245e-41ca-b252-03a870931c30 tempest-ProjectReaderTests-1134609247 None] Acquiring lock "cinder-quobyte-9d032e98-338b-4fa5-89a1-05036e44735b" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:06:31 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7dac749e-245e-41ca-b252-03a870931c30 tempest-ProjectReaderTests-1134609247 None] Lock "cinder-quobyte-9d032e98-338b-4fa5-89a1-05036e44735b" acquired by "delete_volume" :: waited 0.028s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:06:31 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f24476-7068-4240-a63f-a5938d966be4]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:06:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7dac749e-245e-41ca-b252-03a870931c30 tempest-ProjectReaderTests-1134609247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9d032e98-338b-4fa5-89a1-05036e44735b {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:32 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9d032e98-338b-4fa5-89a1-05036e44735b Sep 21 12:06:32 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:32 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7dac749e-245e-41ca-b252-03a870931c30 tempest-ProjectReaderTests-1134609247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9d032e98-338b-4fa5-89a1-05036e44735b" returned: 0 in 0.539s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7dac749e-245e-41ca-b252-03a870931c30 tempest-ProjectReaderTests-1134609247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9d032e98-338b-4fa5-89a1-05036e44735b {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:32 devstack sudo[101808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9d032e98-338b-4fa5-89a1-05036e44735b Sep 21 12:06:32 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:32 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7dac749e-245e-41ca-b252-03a870931c30 tempest-ProjectReaderTests-1134609247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9d032e98-338b-4fa5-89a1-05036e44735b" returned: 0 in 0.376s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:32 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7dac749e-245e-41ca-b252-03a870931c30 tempest-ProjectReaderTests-1134609247 None] Lock "cinder-quobyte-9d032e98-338b-4fa5-89a1-05036e44735b" released by "delete_volume" :: held 1.056s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:32 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-7dac749e-245e-41ca-b252-03a870931c30 tempest-ProjectReaderTests-1134609247 None] Created reservations ['d3ba864d-e891-46eb-a692-7ecf6f67a251', '0d05265c-3bdd-42b2-955e-6c047f102abf', 'e63db7ad-bcb7-46e2-861c-826211efb02b', '75af3e6e-88c0-48fc-9b96-da42e95d187e'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:06:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7dac749e-245e-41ca-b252-03a870931c30 tempest-ProjectReaderTests-1134609247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7dac749e-245e-41ca-b252-03a870931c30 tempest-ProjectReaderTests-1134609247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-7dac749e-245e-41ca-b252-03a870931c30 tempest-ProjectReaderTests-1134609247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:06:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-7dac749e-245e-41ca-b252-03a870931c30 tempest-ProjectReaderTests-1134609247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:06:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7dac749e-245e-41ca-b252-03a870931c30 tempest-ProjectReaderTests-1134609247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7dac749e-245e-41ca-b252-03a870931c30 tempest-ProjectReaderTests-1134609247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:33 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:06:33 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:33 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7dac749e-245e-41ca-b252-03a870931c30 tempest-ProjectReaderTests-1134609247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.326s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:33 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-7dac749e-245e-41ca-b252-03a870931c30 tempest-ProjectReaderTests-1134609247 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:06:33 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-7dac749e-245e-41ca-b252-03a870931c30 tempest-ProjectReaderTests-1134609247 None] Deleted volume successfully. Sep 21 12:06:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7dac749e-245e-41ca-b252-03a870931c30 tempest-ProjectReaderTests-1134609247 None] Lock "cinder-9d032e98-338b-4fa5-89a1-05036e44735b-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:34 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:06:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Flow 'volume_create_manager' (f58069ec-ec51-476d-b5de-4cc65d492a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:06:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14208ebd-d9ca-4e22-b40d-83b2027962ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14208ebd-d9ca-4e22-b40d-83b2027962ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1272530180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9432cd5c-0d4b-479d-a042-93a5302ef708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b516002f094dbbba096e6c881203e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:06:35Z,use_quota=True,user_id='82cf50c5370b440497281f778ab2531f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd5d30ea-898c-459e-836c-524732472be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd5d30ea-898c-459e-836c-524732472be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e48153b4-c714-45f2-a78f-cae79281f3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e48153b4-c714-45f2-a78f-cae79281f3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9432cd5c-0d4b-479d-a042-93a5302ef708', 'volume_name': 'volume-9432cd5c-0d4b-479d-a042-93a5302ef708', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ce49bf2-f668-4d4b-b5e8-558355d0d4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ce49bf2-f668-4d4b-b5e8-558355d0d4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952f71f6-4ffe-4fea-9e31-9d53ca6cee98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:34 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Volume 9432cd5c-0d4b-479d-a042-93a5302ef708: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9432cd5c-0d4b-479d-a042-93a5302ef708', 'volume_size': 1} Sep 21 12:06:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:34 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1272530180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9432cd5c-0d4b-479d-a042-93a5302ef708,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b516002f094dbbba096e6c881203e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:06:35Z,use_quota=True,user_id='82cf50c5370b440497281f778ab2531f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:06:34 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Creating volume 9432cd5c-0d4b-479d-a042-93a5302ef708 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:06:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:34 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:06:34 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:06:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:34 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:06:34 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:06:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9432cd5c-0d4b-479d-a042-93a5302ef708 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:34 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9432cd5c-0d4b-479d-a042-93a5302ef708 1073741824 Sep 21 12:06:34 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:35 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9432cd5c-0d4b-479d-a042-93a5302ef708 1073741824" returned: 0 in 0.549s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9432cd5c-0d4b-479d-a042-93a5302ef708 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:35 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9432cd5c-0d4b-479d-a042-93a5302ef708 Sep 21 12:06:35 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:35 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9432cd5c-0d4b-479d-a042-93a5302ef708" returned: 0 in 0.308s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:06:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952f71f6-4ffe-4fea-9e31-9d53ca6cee98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9432cd5c-0d4b-479d-a042-93a5302ef708', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3547b5ae-4c80-4dbd-8efc-40227d9005c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:35 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Volume volume-9432cd5c-0d4b-479d-a042-93a5302ef708 (9432cd5c-0d4b-479d-a042-93a5302ef708): created successfully Sep 21 12:06:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3547b5ae-4c80-4dbd-8efc-40227d9005c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Flow 'volume_create_manager' (f58069ec-ec51-476d-b5de-4cc65d492a93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:06:35 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1cad140f-fee8-4575-ad45-dd1fc4501f95 tempest-ProjectReaderTests-1134609247 None] Created volume successfully. Sep 21 12:06:36 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b2d8d03d-e45a-413e-ba5d-e6ed5de2eeb5 tempest-ProjectReaderTests-1134609247 None] Acquiring lock "cinder-9432cd5c-0d4b-479d-a042-93a5302ef708-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:06:36 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b2d8d03d-e45a-413e-ba5d-e6ed5de2eeb5 tempest-ProjectReaderTests-1134609247 None] Lock "cinder-9432cd5c-0d4b-479d-a042-93a5302ef708-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:06:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b2d8d03d-e45a-413e-ba5d-e6ed5de2eeb5 tempest-ProjectReaderTests-1134609247 None] Acquiring lock "cinder-quobyte-9432cd5c-0d4b-479d-a042-93a5302ef708" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:06:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b2d8d03d-e45a-413e-ba5d-e6ed5de2eeb5 tempest-ProjectReaderTests-1134609247 None] Lock "cinder-quobyte-9432cd5c-0d4b-479d-a042-93a5302ef708" acquired by "delete_volume" :: waited 0.024s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:06:37 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81aeb91-87a6-4a35-b504-80c3fd99cc6e]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:06:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b2d8d03d-e45a-413e-ba5d-e6ed5de2eeb5 tempest-ProjectReaderTests-1134609247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9432cd5c-0d4b-479d-a042-93a5302ef708 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:37 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9432cd5c-0d4b-479d-a042-93a5302ef708 Sep 21 12:06:37 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:37 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b2d8d03d-e45a-413e-ba5d-e6ed5de2eeb5 tempest-ProjectReaderTests-1134609247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9432cd5c-0d4b-479d-a042-93a5302ef708" returned: 0 in 0.435s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b2d8d03d-e45a-413e-ba5d-e6ed5de2eeb5 tempest-ProjectReaderTests-1134609247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9432cd5c-0d4b-479d-a042-93a5302ef708 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:37 devstack sudo[101847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9432cd5c-0d4b-479d-a042-93a5302ef708 Sep 21 12:06:37 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:37 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b2d8d03d-e45a-413e-ba5d-e6ed5de2eeb5 tempest-ProjectReaderTests-1134609247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9432cd5c-0d4b-479d-a042-93a5302ef708" returned: 0 in 0.307s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b2d8d03d-e45a-413e-ba5d-e6ed5de2eeb5 tempest-ProjectReaderTests-1134609247 None] Lock "cinder-quobyte-9432cd5c-0d4b-479d-a042-93a5302ef708" released by "delete_volume" :: held 0.810s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:37 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-b2d8d03d-e45a-413e-ba5d-e6ed5de2eeb5 tempest-ProjectReaderTests-1134609247 None] Created reservations ['95435758-ad0b-485f-b88e-8432a729e8ed', 'e110a8b2-b683-44d8-8c87-c030544ce6e4', '035ec60b-a90b-4417-9e21-df7db1f20808', 'd06ffd2b-0fc4-429e-9433-03f934d5cc35'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b2d8d03d-e45a-413e-ba5d-e6ed5de2eeb5 tempest-ProjectReaderTests-1134609247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b2d8d03d-e45a-413e-ba5d-e6ed5de2eeb5 tempest-ProjectReaderTests-1134609247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b2d8d03d-e45a-413e-ba5d-e6ed5de2eeb5 tempest-ProjectReaderTests-1134609247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b2d8d03d-e45a-413e-ba5d-e6ed5de2eeb5 tempest-ProjectReaderTests-1134609247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b2d8d03d-e45a-413e-ba5d-e6ed5de2eeb5 tempest-ProjectReaderTests-1134609247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b2d8d03d-e45a-413e-ba5d-e6ed5de2eeb5 tempest-ProjectReaderTests-1134609247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:38 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:06:38 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:38 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b2d8d03d-e45a-413e-ba5d-e6ed5de2eeb5 tempest-ProjectReaderTests-1134609247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.309s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-b2d8d03d-e45a-413e-ba5d-e6ed5de2eeb5 tempest-ProjectReaderTests-1134609247 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:06:38 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-b2d8d03d-e45a-413e-ba5d-e6ed5de2eeb5 tempest-ProjectReaderTests-1134609247 None] Deleted volume successfully. Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b2d8d03d-e45a-413e-ba5d-e6ed5de2eeb5 tempest-ProjectReaderTests-1134609247 None] Lock "cinder-9432cd5c-0d4b-479d-a042-93a5302ef708-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Flow 'volume_create_manager' (51154c32-3eab-46c5-919a-bf0c65b5490c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b209de79-8d4c-4dc7-8a34-c1f6ae99d6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b209de79-8d4c-4dc7-8a34-c1f6ae99d6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1219512508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c9f78bb-ac6d-4154-8c32-16f90511e606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c434e30238f4432088e69b0dbd1ce4bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d7981b4b-ad21-4ecc-b2ea-57e475074452,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:06:39Z,use_quota=True,user_id='8a70ff09abb44ca9b2f9a9f95a4de407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (005f624f-d94d-4f46-98c8-c2b9edf4088e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (005f624f-d94d-4f46-98c8-c2b9edf4088e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15405720-a69f-48ab-8e6a-e37310c8108f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15405720-a69f-48ab-8e6a-e37310c8108f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3c9f78bb-ac6d-4154-8c32-16f90511e606', 'volume_name': 'volume-3c9f78bb-ac6d-4154-8c32-16f90511e606', 'volume_size': 1, 'snapshot_id': 'd7981b4b-ad21-4ecc-b2ea-57e475074452'}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5fbd52d-1d89-4d56-9879-6ade7eb4f262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5fbd52d-1d89-4d56-9879-6ade7eb4f262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e213969b-953e-4d5c-8ba3-90c413e24c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:38 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Volume 3c9f78bb-ac6d-4154-8c32-16f90511e606: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3c9f78bb-ac6d-4154-8c32-16f90511e606', 'volume_size': 1, 'snapshot_id': 'd7981b4b-ad21-4ecc-b2ea-57e475074452'} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Acquiring lock "cinder-quobyte-d7981b4b-ad21-4ecc-b2ea-57e475074452-3c9f78bb-ac6d-4154-8c32-16f90511e606" by "_create_volume_from_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Lock "cinder-quobyte-d7981b4b-ad21-4ecc-b2ea-57e475074452-3c9f78bb-ac6d-4154-8c32-16f90511e606" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Creating volume 3c9f78bb-ac6d-4154-8c32-16f90511e606 from snapshot d7981b4b-ad21-4ecc-b2ea-57e475074452 {{(pid=86366) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Acquiring lock "cinder-quobyte-3c9f78bb-ac6d-4154-8c32-16f90511e606" by "_copy_volume_from_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Lock "cinder-quobyte-3c9f78bb-ac6d-4154-8c32-16f90511e606" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] snapshot: d7981b4b-ad21-4ecc-b2ea-57e475074452, volume: 3c9f78bb-ac6d-4154-8c32-16f90511e606, {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c191dbd-0a85-42ad-ac3d-45c3362a2ece]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:06:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.d7981b4b-ad21-4ecc-b2ea-57e475074452 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:39 devstack sudo[101853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.d7981b4b-ad21-4ecc-b2ea-57e475074452 Sep 21 12:06:39 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:39 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:06:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Flow 'volume_create_manager' (ecf9e192-128f-495a-8f7e-a7b70d6513cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:06:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28f808ef-413f-4635-a028-94ea53601321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28f808ef-413f-4635-a028-94ea53601321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-298081438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ace0c388-2f68-4d32-991f-47fd9a54a2d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b516002f094dbbba096e6c881203e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:06:39Z,use_quota=True,user_id='82cf50c5370b440497281f778ab2531f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd525f12-910c-4e82-b239-9cd0b880dcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd525f12-910c-4e82-b239-9cd0b880dcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfbd7757-1732-44a8-9095-0005614e84e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfbd7757-1732-44a8-9095-0005614e84e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ace0c388-2f68-4d32-991f-47fd9a54a2d2', 'volume_name': 'volume-ace0c388-2f68-4d32-991f-47fd9a54a2d2', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a2e7c1-52e6-46b8-b209-5b5b32413990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a2e7c1-52e6-46b8-b209-5b5b32413990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b368565-6781-4395-b213-2eaebdb99512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:39 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Volume ace0c388-2f68-4d32-991f-47fd9a54a2d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ace0c388-2f68-4d32-991f-47fd9a54a2d2', 'volume_size': 1} Sep 21 12:06:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:39 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.d7981b4b-ad21-4ecc-b2ea-57e475074452" returned: 0 in 0.459s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:39 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-241e3e59-081b-4241-b3de-75aafd49db55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:06:39 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[41444f4b-4eee-4ef6-8170-8503b9de4254]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:06:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:39 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55 Sep 21 12:06:39 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:39 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55" returned: 0 in 0.425s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:39 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55 {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 21 12:06:39 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Creating direct copy from snapshot {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 21 12:06:39 devstack cinder-volume[86366]: DEBUG cinder.utils [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Path /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3c9f78bb-ac6d-4154-8c32-16f90511e606 not found in is_blk_device check {{(pid=86366) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 21 12:06:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3c9f78bb-ac6d-4154-8c32-16f90511e606 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:39 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3c9f78bb-ac6d-4154-8c32-16f90511e606 Sep 21 12:06:39 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:48 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=100,cinder:UPDATE=122,cinder:INSERT=26,cinder:DELETE=9 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:06:49 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:UPDATE=109,cinder:INSERT=32,cinder:DELETE=11,cinder:SELECT=99 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:06:49 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3c9f78bb-ac6d-4154-8c32-16f90511e606" returned: 0 in 9.608s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:49 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Image conversion details: src /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55, size 1024.00 MB, duration 9.61 sec, destination /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3c9f78bb-ac6d-4154-8c32-16f90511e606 {{(pid=86366) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 12:06:49 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Converted 1024.00 MB image at 106.56 MB/s Sep 21 12:06:49 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3c9f78bb-ac6d-4154-8c32-16f90511e606 is being set with open permissions: ugo+rw Sep 21 12:06:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3c9f78bb-ac6d-4154-8c32-16f90511e606 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:49 devstack sudo[101945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3c9f78bb-ac6d-4154-8c32-16f90511e606 Sep 21 12:06:49 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:49 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3c9f78bb-ac6d-4154-8c32-16f90511e606" returned: 0 in 0.363s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Lock "cinder-quobyte-3c9f78bb-ac6d-4154-8c32-16f90511e606" released by "_copy_volume_from_snapshot" :: held 10.980s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Lock "cinder-quobyte-d7981b4b-ad21-4ecc-b2ea-57e475074452-3c9f78bb-ac6d-4154-8c32-16f90511e606" released by "_create_volume_from_snapshot" :: held 11.088s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.112s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.701s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:49 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-298081438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ace0c388-2f68-4d32-991f-47fd9a54a2d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b516002f094dbbba096e6c881203e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:06:39Z,use_quota=True,user_id='82cf50c5370b440497281f778ab2531f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:06:49 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Creating volume ace0c388-2f68-4d32-991f-47fd9a54a2d2 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:06:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:49 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:06:49 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:06:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:49 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:06:49 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:06:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ace0c388-2f68-4d32-991f-47fd9a54a2d2 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:49 devstack sudo[101950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ace0c388-2f68-4d32-991f-47fd9a54a2d2 1073741824 Sep 21 12:06:49 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e213969b-953e-4d5c-8ba3-90c413e24c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c9f78bb-ac6d-4154-8c32-16f90511e606', 'volume_size': 1, 'snapshot_id': 'd7981b4b-ad21-4ecc-b2ea-57e475074452'}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b487281d-aa4e-4fdc-b7a7-2dd8de957df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:50 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Volume volume-3c9f78bb-ac6d-4154-8c32-16f90511e606 (3c9f78bb-ac6d-4154-8c32-16f90511e606): created successfully Sep 21 12:06:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b487281d-aa4e-4fdc-b7a7-2dd8de957df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Flow 'volume_create_manager' (51154c32-3eab-46c5-919a-bf0c65b5490c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:06:50 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-c99a8e6d-93ff-49a7-b0d1-64b1e71251da tempest-TestStampPattern-1856543467 None] Created volume successfully. Sep 21 12:06:50 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ace0c388-2f68-4d32-991f-47fd9a54a2d2 1073741824" returned: 0 in 0.649s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ace0c388-2f68-4d32-991f-47fd9a54a2d2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:50 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ace0c388-2f68-4d32-991f-47fd9a54a2d2 Sep 21 12:06:50 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:50 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ace0c388-2f68-4d32-991f-47fd9a54a2d2" returned: 0 in 0.306s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:50 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:06:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b368565-6781-4395-b213-2eaebdb99512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ace0c388-2f68-4d32-991f-47fd9a54a2d2', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339e53ed-357f-4f30-ad5f-06f64e41c4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:50 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Volume volume-ace0c388-2f68-4d32-991f-47fd9a54a2d2 (ace0c388-2f68-4d32-991f-47fd9a54a2d2): created successfully Sep 21 12:06:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339e53ed-357f-4f30-ad5f-06f64e41c4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Flow 'volume_create_manager' (ecf9e192-128f-495a-8f7e-a7b70d6513cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:06:51 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-66b9fb01-9ac4-4640-b38c-10d05c6fabf9 tempest-ProjectReaderTests-1134609247 None] Created volume successfully. Sep 21 12:06:51 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-98874323-b35d-4930-ac2f-7079c81c56ae tempest-ProjectReaderTests-1134609247 None] Acquiring lock "cinder-ace0c388-2f68-4d32-991f-47fd9a54a2d2-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:06:51 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-98874323-b35d-4930-ac2f-7079c81c56ae tempest-ProjectReaderTests-1134609247 None] Lock "cinder-ace0c388-2f68-4d32-991f-47fd9a54a2d2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:06:51 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-98874323-b35d-4930-ac2f-7079c81c56ae tempest-ProjectReaderTests-1134609247 None] Acquiring lock "cinder-quobyte-ace0c388-2f68-4d32-991f-47fd9a54a2d2" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:06:51 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-98874323-b35d-4930-ac2f-7079c81c56ae tempest-ProjectReaderTests-1134609247 None] Lock "cinder-quobyte-ace0c388-2f68-4d32-991f-47fd9a54a2d2" acquired by "delete_volume" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:06:51 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede16fe9-4244-4e0c-a7e9-3e018936c7fd]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:06:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-98874323-b35d-4930-ac2f-7079c81c56ae tempest-ProjectReaderTests-1134609247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ace0c388-2f68-4d32-991f-47fd9a54a2d2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:51 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ace0c388-2f68-4d32-991f-47fd9a54a2d2 Sep 21 12:06:51 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:52 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-98874323-b35d-4930-ac2f-7079c81c56ae tempest-ProjectReaderTests-1134609247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ace0c388-2f68-4d32-991f-47fd9a54a2d2" returned: 0 in 0.477s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-98874323-b35d-4930-ac2f-7079c81c56ae tempest-ProjectReaderTests-1134609247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ace0c388-2f68-4d32-991f-47fd9a54a2d2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:52 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ace0c388-2f68-4d32-991f-47fd9a54a2d2 Sep 21 12:06:52 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:52 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-98874323-b35d-4930-ac2f-7079c81c56ae tempest-ProjectReaderTests-1134609247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ace0c388-2f68-4d32-991f-47fd9a54a2d2" returned: 0 in 0.417s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:52 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-98874323-b35d-4930-ac2f-7079c81c56ae tempest-ProjectReaderTests-1134609247 None] Lock "cinder-quobyte-ace0c388-2f68-4d32-991f-47fd9a54a2d2" released by "delete_volume" :: held 0.960s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:52 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-98874323-b35d-4930-ac2f-7079c81c56ae tempest-ProjectReaderTests-1134609247 None] Created reservations ['f0af3d16-81ca-4248-aaf1-ac7bd1f8a420', 'a8ce742d-2435-4297-adf6-b115856f6f03', '7204bd4f-9817-4a27-abed-43ae45dd17a6', 'd2e703c3-1782-4c2e-839c-4b3e3800f3ef'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:06:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-98874323-b35d-4930-ac2f-7079c81c56ae tempest-ProjectReaderTests-1134609247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-98874323-b35d-4930-ac2f-7079c81c56ae tempest-ProjectReaderTests-1134609247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-98874323-b35d-4930-ac2f-7079c81c56ae tempest-ProjectReaderTests-1134609247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:06:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-98874323-b35d-4930-ac2f-7079c81c56ae tempest-ProjectReaderTests-1134609247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:06:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-98874323-b35d-4930-ac2f-7079c81c56ae tempest-ProjectReaderTests-1134609247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-98874323-b35d-4930-ac2f-7079c81c56ae tempest-ProjectReaderTests-1134609247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:52 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:06:52 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:53 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-98874323-b35d-4930-ac2f-7079c81c56ae tempest-ProjectReaderTests-1134609247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.407s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:53 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-98874323-b35d-4930-ac2f-7079c81c56ae tempest-ProjectReaderTests-1134609247 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:06:53 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-98874323-b35d-4930-ac2f-7079c81c56ae tempest-ProjectReaderTests-1134609247 None] Deleted volume successfully. Sep 21 12:06:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-98874323-b35d-4930-ac2f-7079c81c56ae tempest-ProjectReaderTests-1134609247 None] Lock "cinder-ace0c388-2f68-4d32-991f-47fd9a54a2d2-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Flow 'volume_create_manager' (f70380dc-2394-4777-8bb4-c8811c132248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14cea738-d6e5-4ecd-8de8-bb30dd2a81a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14cea738-d6e5-4ecd-8de8-bb30dd2a81a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-260893189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b0ede80-4a64-4fbc-9f83-94b9ae2e2001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db28e6d28b54d609a4e06fac3b2da3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:06:57Z,use_quota=True,user_id='0ad85466d9794449b0c25cc032aaa41d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3787f9-f51f-4180-a3d6-eb4022f35391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3787f9-f51f-4180-a3d6-eb4022f35391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aa778c2-9030-4bc8-b972-24ca919d454d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aa778c2-9030-4bc8-b972-24ca919d454d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b0ede80-4a64-4fbc-9f83-94b9ae2e2001', 'volume_name': 'volume-3b0ede80-4a64-4fbc-9f83-94b9ae2e2001', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4c709f6-eadc-4fe0-9550-12da28ce0406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4c709f6-eadc-4fe0-9550-12da28ce0406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be02b44b-3a7f-49e8-b921-343261c2acde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:57 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Volume 3b0ede80-4a64-4fbc-9f83-94b9ae2e2001: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b0ede80-4a64-4fbc-9f83-94b9ae2e2001', 'volume_size': 1} Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-260893189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b0ede80-4a64-4fbc-9f83-94b9ae2e2001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db28e6d28b54d609a4e06fac3b2da3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:06:57Z,use_quota=True,user_id='0ad85466d9794449b0c25cc032aaa41d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Creating volume 3b0ede80-4a64-4fbc-9f83-94b9ae2e2001 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:06:57 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3b0ede80-4a64-4fbc-9f83-94b9ae2e2001 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:57 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3b0ede80-4a64-4fbc-9f83-94b9ae2e2001 1073741824 Sep 21 12:06:57 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Flow 'volume_create_manager' (ae7928d7-c14b-4cf5-81bc-54cc081814ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0962fe54-d18a-4ea6-8ad0-ac8c731f4b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0962fe54-d18a-4ea6-8ad0-ac8c731f4b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1727783877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0ba1165-dd69-4ac3-b941-9da2b7e821f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db28e6d28b54d609a4e06fac3b2da3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:06:58Z,use_quota=True,user_id='0ad85466d9794449b0c25cc032aaa41d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febf9a83-6d5c-460e-8a6f-51e779cce60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febf9a83-6d5c-460e-8a6f-51e779cce60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e1805a-424b-4fec-883b-f256d123e86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e1805a-424b-4fec-883b-f256d123e86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0ba1165-dd69-4ac3-b941-9da2b7e821f2', 'volume_name': 'volume-d0ba1165-dd69-4ac3-b941-9da2b7e821f2', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a26db6c-02f7-4613-b740-9b1357b47d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a26db6c-02f7-4613-b740-9b1357b47d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f22eda8-3d57-43e8-826d-b37a3d39ef47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:58 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Volume d0ba1165-dd69-4ac3-b941-9da2b7e821f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0ba1165-dd69-4ac3-b941-9da2b7e821f2', 'volume_size': 1} Sep 21 12:06:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:58 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3b0ede80-4a64-4fbc-9f83-94b9ae2e2001 1073741824" returned: 0 in 0.688s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3b0ede80-4a64-4fbc-9f83-94b9ae2e2001 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:58 devstack sudo[102018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3b0ede80-4a64-4fbc-9f83-94b9ae2e2001 Sep 21 12:06:58 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:58 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3b0ede80-4a64-4fbc-9f83-94b9ae2e2001" returned: 0 in 0.625s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:06:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.754s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1727783877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0ba1165-dd69-4ac3-b941-9da2b7e821f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3db28e6d28b54d609a4e06fac3b2da3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:06:58Z,use_quota=True,user_id='0ad85466d9794449b0c25cc032aaa41d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:06:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Creating volume d0ba1165-dd69-4ac3-b941-9da2b7e821f2 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:06:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:06:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:06:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:06:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:06:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:06:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:06:58 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:06:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d0ba1165-dd69-4ac3-b941-9da2b7e821f2 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be02b44b-3a7f-49e8-b921-343261c2acde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b0ede80-4a64-4fbc-9f83-94b9ae2e2001', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70a5997-abab-48a3-b60b-01ca20fd9180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:06:58 devstack sudo[102029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d0ba1165-dd69-4ac3-b941-9da2b7e821f2 1073741824 Sep 21 12:06:58 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:58 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Volume volume-3b0ede80-4a64-4fbc-9f83-94b9ae2e2001 (3b0ede80-4a64-4fbc-9f83-94b9ae2e2001): created successfully Sep 21 12:06:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70a5997-abab-48a3-b60b-01ca20fd9180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:06:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Flow 'volume_create_manager' (f70380dc-2394-4777-8bb4-c8811c132248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:06:58 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-17ca24a2-5bf2-4567-b41b-44ad0730850a tempest-TestServerVolumeAttachmentScenario-1801514564 None] Created volume successfully. Sep 21 12:06:59 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d0ba1165-dd69-4ac3-b941-9da2b7e821f2 1073741824" returned: 0 in 0.713s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d0ba1165-dd69-4ac3-b941-9da2b7e821f2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:06:59 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d0ba1165-dd69-4ac3-b941-9da2b7e821f2 Sep 21 12:06:59 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:06:59 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Sep 21 12:06:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d0ba1165-dd69-4ac3-b941-9da2b7e821f2" returned: 0 in 0.386s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:06:59 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:06:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:07:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f22eda8-3d57-43e8-826d-b37a3d39ef47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0ba1165-dd69-4ac3-b941-9da2b7e821f2', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:07:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfccc03f-13e6-419d-8839-c840a638c853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:07:00 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Volume volume-d0ba1165-dd69-4ac3-b941-9da2b7e821f2 (d0ba1165-dd69-4ac3-b941-9da2b7e821f2): created successfully Sep 21 12:07:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfccc03f-13e6-419d-8839-c840a638c853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:07:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Flow 'volume_create_manager' (ae7928d7-c14b-4cf5-81bc-54cc081814ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:07:00 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-9be71878-dbc4-4cb3-ab2f-52c18a47c526 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Created volume successfully. Sep 21 12:07:03 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 12:07:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:07:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:07:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:07:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:07:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:07:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:03 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:07:03 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:04 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.427s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:04 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:07:04 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 12:07:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread count: 28 {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 12:07:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread info: [<_MainThread(MainThread, started 132841976594560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 12:07:10 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:UPDATE=17,cinder:INSERT=3,cinder:SELECT=14,cinder:DELETE=1 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:07:10 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=9,cinder:UPDATE=21,cinder:DELETE=4,cinder:INSERT=5 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:07:23 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:07:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Flow 'volume_create_manager' (17f3f8d3-8b4f-48bb-adee-a31e7a77a698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:07:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e4fef6a-b760-44ac-8ef9-aabcb2ca84e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:07:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e4fef6a-b760-44ac-8ef9-aabcb2ca84e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1836622848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd8a46b-46ca-4f1c-8f38-ee149be33187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='572436dc77094d1baf039757dcb0938a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:07:23Z,use_quota=True,user_id='d9227fffac024cc9aa26530e3bb9995a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:07:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae2f4927-3652-4341-8792-1bf232a197bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:07:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae2f4927-3652-4341-8792-1bf232a197bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:07:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9716c485-cb60-4fa7-84dd-ea8f3b3de2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:07:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9716c485-cb60-4fa7-84dd-ea8f3b3de2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcd8a46b-46ca-4f1c-8f38-ee149be33187', 'volume_name': 'volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:07:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8407b5cc-5002-4e2b-9e91-68b934c57753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:07:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8407b5cc-5002-4e2b-9e91-68b934c57753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:07:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e663833e-02c1-4107-a5ac-a8d02ebc3422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:07:23 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Volume dcd8a46b-46ca-4f1c-8f38-ee149be33187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187', 'volume_size': 1} Sep 21 12:07:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:07:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:07:23 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1836622848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd8a46b-46ca-4f1c-8f38-ee149be33187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='572436dc77094d1baf039757dcb0938a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:07:23Z,use_quota=True,user_id='d9227fffac024cc9aa26530e3bb9995a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:07:23 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Creating volume dcd8a46b-46ca-4f1c-8f38-ee149be33187 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:07:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:07:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:07:23 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:07:23 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:07:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:07:23 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:07:23 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:07:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:23 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187 1073741824 Sep 21 12:07:23 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:23 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187 1073741824" returned: 0 in 0.521s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:23 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187 Sep 21 12:07:23 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:24 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187" returned: 0 in 0.280s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:24 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:07:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:07:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e663833e-02c1-4107-a5ac-a8d02ebc3422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:07:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90916ae-52ff-44c5-ba51-44b811bb491e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:07:24 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Volume volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187 (dcd8a46b-46ca-4f1c-8f38-ee149be33187): created successfully Sep 21 12:07:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90916ae-52ff-44c5-ba51-44b811bb491e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:07:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Flow 'volume_create_manager' (17f3f8d3-8b4f-48bb-adee-a31e7a77a698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:07:24 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-f5f4daf6-aabe-417e-9921-7c33626b262d tempest-SnapshotDependencyTests-1299266856 None] Created volume successfully. Sep 21 12:07:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-381baa32-bf9d-44a9-a616-2339875487ef tempest-SnapshotDependencyTests-1299266856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:07:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-381baa32-bf9d-44a9-a616-2339875487ef tempest-SnapshotDependencyTests-1299266856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:07:25 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-381baa32-bf9d-44a9-a616-2339875487ef tempest-SnapshotDependencyTests-1299266856 None] Creating offline snapshot 28bb447b-0102-48c6-aae2-bfbf5036160e of volume dcd8a46b-46ca-4f1c-8f38-ee149be33187 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:07:25 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca529ac-0a18-435b-aa90-5af7efcc4b37]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:07:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-381baa32-bf9d-44a9-a616-2339875487ef tempest-SnapshotDependencyTests-1299266856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:25 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187 Sep 21 12:07:25 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:26 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-381baa32-bf9d-44a9-a616-2339875487ef tempest-SnapshotDependencyTests-1299266856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187" returned: 0 in 0.381s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-381baa32-bf9d-44a9-a616-2339875487ef tempest-SnapshotDependencyTests-1299266856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.28bb447b-0102-48c6-aae2-bfbf5036160e 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:26 devstack sudo[102185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.28bb447b-0102-48c6-aae2-bfbf5036160e 1G Sep 21 12:07:26 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:26 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-381baa32-bf9d-44a9-a616-2339875487ef tempest-SnapshotDependencyTests-1299266856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.28bb447b-0102-48c6-aae2-bfbf5036160e 1G" returned: 0 in 0.417s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-381baa32-bf9d-44a9-a616-2339875487ef tempest-SnapshotDependencyTests-1299266856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.28bb447b-0102-48c6-aae2-bfbf5036160e {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:26 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.28bb447b-0102-48c6-aae2-bfbf5036160e Sep 21 12:07:26 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:26 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-381baa32-bf9d-44a9-a616-2339875487ef tempest-SnapshotDependencyTests-1299266856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.28bb447b-0102-48c6-aae2-bfbf5036160e" returned: 0 in 0.294s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:26 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-381baa32-bf9d-44a9-a616-2339875487ef tempest-SnapshotDependencyTests-1299266856 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.28bb447b-0102-48c6-aae2-bfbf5036160e is being set with open permissions: ugo+rw Sep 21 12:07:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-381baa32-bf9d-44a9-a616-2339875487ef tempest-SnapshotDependencyTests-1299266856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.28bb447b-0102-48c6-aae2-bfbf5036160e {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:26 devstack sudo[102197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.28bb447b-0102-48c6-aae2-bfbf5036160e Sep 21 12:07:26 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:27 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-381baa32-bf9d-44a9-a616-2339875487ef tempest-SnapshotDependencyTests-1299266856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.28bb447b-0102-48c6-aae2-bfbf5036160e" returned: 0 in 0.261s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-381baa32-bf9d-44a9-a616-2339875487ef tempest-SnapshotDependencyTests-1299266856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:27 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.info Sep 21 12:07:27 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:27 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-381baa32-bf9d-44a9-a616-2339875487ef tempest-SnapshotDependencyTests-1299266856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.info" returned: 0 in 0.282s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:27 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-381baa32-bf9d-44a9-a616-2339875487ef tempest-SnapshotDependencyTests-1299266856 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.info is being set with open permissions: ugo+rw Sep 21 12:07:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-381baa32-bf9d-44a9-a616-2339875487ef tempest-SnapshotDependencyTests-1299266856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:27 devstack sudo[102203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.info Sep 21 12:07:27 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:27 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-381baa32-bf9d-44a9-a616-2339875487ef tempest-SnapshotDependencyTests-1299266856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.info" returned: 0 in 0.256s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-381baa32-bf9d-44a9-a616-2339875487ef tempest-SnapshotDependencyTests-1299266856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.987s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:07:27 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-381baa32-bf9d-44a9-a616-2339875487ef tempest-SnapshotDependencyTests-1299266856 None] Create snapshot completed successfully Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Flow 'volume_create_manager' (e2114c45-ca40-4f5d-9d66-6d72c4e53b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a2daa11-d460-4728-814b-28b2d13f605f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a2daa11-d460-4728-814b-28b2d13f605f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa816ec0-a54b-45aa-82b4-f218e6281537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='572436dc77094d1baf039757dcb0938a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:07:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=28bb447b-0102-48c6-aae2-bfbf5036160e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:07:29Z,use_quota=True,user_id='d9227fffac024cc9aa26530e3bb9995a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3e611c-170a-4db1-8a41-fb7863aba39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3e611c-170a-4db1-8a41-fb7863aba39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da933e5b-5e70-4005-91e9-0d9978681a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da933e5b-5e70-4005-91e9-0d9978681a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aa816ec0-a54b-45aa-82b4-f218e6281537', 'volume_name': 'volume-aa816ec0-a54b-45aa-82b4-f218e6281537', 'volume_size': 1, 'snapshot_id': '28bb447b-0102-48c6-aae2-bfbf5036160e'}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6633284a-9014-4586-a87a-ac22f9310d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6633284a-9014-4586-a87a-ac22f9310d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bde2aea-9681-44fe-88f5-3154ddbbb113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:07:29 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Volume aa816ec0-a54b-45aa-82b4-f218e6281537: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aa816ec0-a54b-45aa-82b4-f218e6281537', 'volume_size': 1, 'snapshot_id': '28bb447b-0102-48c6-aae2-bfbf5036160e'} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Acquiring lock "cinder-quobyte-28bb447b-0102-48c6-aae2-bfbf5036160e-aa816ec0-a54b-45aa-82b4-f218e6281537" by "_create_volume_from_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Lock "cinder-quobyte-28bb447b-0102-48c6-aae2-bfbf5036160e-aa816ec0-a54b-45aa-82b4-f218e6281537" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Creating volume aa816ec0-a54b-45aa-82b4-f218e6281537 from snapshot 28bb447b-0102-48c6-aae2-bfbf5036160e {{(pid=86366) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Acquiring lock "cinder-quobyte-aa816ec0-a54b-45aa-82b4-f218e6281537" by "_copy_volume_from_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Lock "cinder-quobyte-aa816ec0-a54b-45aa-82b4-f218e6281537" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] snapshot: 28bb447b-0102-48c6-aae2-bfbf5036160e, volume: aa816ec0-a54b-45aa-82b4-f218e6281537, {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec899db-785d-46d0-b468-a9527c48aa0e]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.28bb447b-0102-48c6-aae2-bfbf5036160e {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:29 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.28bb447b-0102-48c6-aae2-bfbf5036160e Sep 21 12:07:29 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:29 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.28bb447b-0102-48c6-aae2-bfbf5036160e" returned: 0 in 0.342s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c60686e-d2f9-46e7-87ba-0e3bb1033e08]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:07:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:29 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187 Sep 21 12:07:29 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:30 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187" returned: 0 in 0.352s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:30 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187 {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 21 12:07:30 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Creating direct copy from snapshot {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 21 12:07:30 devstack cinder-volume[86366]: DEBUG cinder.utils [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Path /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-aa816ec0-a54b-45aa-82b4-f218e6281537 not found in is_blk_device check {{(pid=86366) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 21 12:07:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-aa816ec0-a54b-45aa-82b4-f218e6281537 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:30 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-aa816ec0-a54b-45aa-82b4-f218e6281537 Sep 21 12:07:30 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-113add41-252b-439e-8d90-d4d417a8f4ff req-acf5df68-7b12-4340-ae91-398f967235d5 tempest-TestStampPattern-1856543467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:07:37 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-aa816ec0-a54b-45aa-82b4-f218e6281537" returned: 0 in 7.151s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:37 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Image conversion details: src /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187, size 1024.00 MB, duration 7.15 sec, destination /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-aa816ec0-a54b-45aa-82b4-f218e6281537 {{(pid=86366) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 12:07:37 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Converted 1024.00 MB image at 143.18 MB/s Sep 21 12:07:37 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-aa816ec0-a54b-45aa-82b4-f218e6281537 is being set with open permissions: ugo+rw Sep 21 12:07:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-aa816ec0-a54b-45aa-82b4-f218e6281537 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:37 devstack sudo[102260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-aa816ec0-a54b-45aa-82b4-f218e6281537 Sep 21 12:07:37 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-0f69ccd2-6128-45f2-a774-77e03c22fa2d req-d9c296de-6d61-477e-884d-dae617ec0b6c tempest-TestServerVolumeAttachmentScenario-1801514564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:07:37 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-aa816ec0-a54b-45aa-82b4-f218e6281537" returned: 0 in 0.245s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Lock "cinder-quobyte-aa816ec0-a54b-45aa-82b4-f218e6281537" released by "_copy_volume_from_snapshot" :: held 8.174s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:07:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Lock "cinder-quobyte-28bb447b-0102-48c6-aae2-bfbf5036160e-aa816ec0-a54b-45aa-82b4-f218e6281537" released by "_create_volume_from_snapshot" :: held 8.228s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:07:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.242s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:07:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-113add41-252b-439e-8d90-d4d417a8f4ff req-acf5df68-7b12-4340-ae91-398f967235d5 tempest-TestStampPattern-1856543467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.764s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:07:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-113add41-252b-439e-8d90-d4d417a8f4ff req-acf5df68-7b12-4340-ae91-398f967235d5 tempest-TestStampPattern-1856543467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:07:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-0f69ccd2-6128-45f2-a774-77e03c22fa2d req-d9c296de-6d61-477e-884d-dae617ec0b6c tempest-TestServerVolumeAttachmentScenario-1801514564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.194s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:07:37 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bde2aea-9681-44fe-88f5-3154ddbbb113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa816ec0-a54b-45aa-82b4-f218e6281537', 'volume_size': 1, 'snapshot_id': '28bb447b-0102-48c6-aae2-bfbf5036160e'}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:07:37 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c7b925c-c686-4404-abd0-f0e3de8af254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:07:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-0f69ccd2-6128-45f2-a774-77e03c22fa2d req-d9c296de-6d61-477e-884d-dae617ec0b6c tempest-TestServerVolumeAttachmentScenario-1801514564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:07:37 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Volume volume-aa816ec0-a54b-45aa-82b4-f218e6281537 (aa816ec0-a54b-45aa-82b4-f218e6281537): created successfully Sep 21 12:07:37 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c7b925c-c686-4404-abd0-f0e3de8af254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:07:37 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Flow 'volume_create_manager' (e2114c45-ca40-4f5d-9d66-6d72c4e53b8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:07:37 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-113add41-252b-439e-8d90-d4d417a8f4ff req-acf5df68-7b12-4340-ae91-398f967235d5 tempest-TestStampPattern-1856543467 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d', 'name': 'volume-3c9f78bb-ac6d-4154-8c32-16f90511e606', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16391404-a243-4813-aa36-877ad88531ff', 'enforce_multipath': True} {{(pid=86366) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 12:07:37 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-6296c59c-d648-4a6c-8752-6b6f019dd49b tempest-SnapshotDependencyTests-1299266856 None] Created volume successfully. Sep 21 12:07:37 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-0f69ccd2-6128-45f2-a774-77e03c22fa2d req-d9c296de-6d61-477e-884d-dae617ec0b6c tempest-TestServerVolumeAttachmentScenario-1801514564 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d', 'name': 'volume-3b0ede80-4a64-4fbc-9f83-94b9ae2e2001', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '960af034-0241-41cb-a995-e67db37f32ec', 'enforce_multipath': True} {{(pid=86366) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 12:07:37 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-113add41-252b-439e-8d90-d4d417a8f4ff req-acf5df68-7b12-4340-ae91-398f967235d5 tempest-TestStampPattern-1856543467 None] attachment_update completed successfully. Sep 21 12:07:37 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-0f69ccd2-6128-45f2-a774-77e03c22fa2d req-d9c296de-6d61-477e-884d-dae617ec0b6c tempest-TestServerVolumeAttachmentScenario-1801514564 None] attachment_update completed successfully. Sep 21 12:07:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a59239a8-938e-442b-a717-c7110d576b5a tempest-SnapshotDependencyTests-1299266856 None] Acquiring lock "cinder-28bb447b-0102-48c6-aae2-bfbf5036160e-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:07:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a59239a8-938e-442b-a717-c7110d576b5a tempest-SnapshotDependencyTests-1299266856 None] Lock "cinder-28bb447b-0102-48c6-aae2-bfbf5036160e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:07:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a59239a8-938e-442b-a717-c7110d576b5a tempest-SnapshotDependencyTests-1299266856 None] Acquiring lock "cinder-quobyte-dcd8a46b-46ca-4f1c-8f38-ee149be33187" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:07:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a59239a8-938e-442b-a717-c7110d576b5a tempest-SnapshotDependencyTests-1299266856 None] Lock "cinder-quobyte-dcd8a46b-46ca-4f1c-8f38-ee149be33187" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:07:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a59239a8-938e-442b-a717-c7110d576b5a tempest-SnapshotDependencyTests-1299266856 None] Acquiring lock "cinder-quobyte-28bb447b-0102-48c6-aae2-bfbf5036160e" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:07:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a59239a8-938e-442b-a717-c7110d576b5a tempest-SnapshotDependencyTests-1299266856 None] Lock "cinder-quobyte-28bb447b-0102-48c6-aae2-bfbf5036160e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:07:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-a59239a8-938e-442b-a717-c7110d576b5a tempest-SnapshotDependencyTests-1299266856 None] Deleting offline snapshot 28bb447b-0102-48c6-aae2-bfbf5036160e of volume dcd8a46b-46ca-4f1c-8f38-ee149be33187 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:07:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-a59239a8-938e-442b-a717-c7110d576b5a tempest-SnapshotDependencyTests-1299266856 None] snapshot_file for this snap is: volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.28bb447b-0102-48c6-aae2-bfbf5036160e {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:07:38 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[051aa5be-f540-4421-8fdd-77618a167f80]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:07:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a59239a8-938e-442b-a717-c7110d576b5a tempest-SnapshotDependencyTests-1299266856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.28bb447b-0102-48c6-aae2-bfbf5036160e {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:38 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.28bb447b-0102-48c6-aae2-bfbf5036160e Sep 21 12:07:38 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:39 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a59239a8-938e-442b-a717-c7110d576b5a tempest-SnapshotDependencyTests-1299266856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.28bb447b-0102-48c6-aae2-bfbf5036160e" returned: 0 in 0.355s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:39 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-a59239a8-938e-442b-a717-c7110d576b5a tempest-SnapshotDependencyTests-1299266856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:07:39 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfaf2b38-dde8-4153-a47d-e0bfad7e5923]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:07:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a59239a8-938e-442b-a717-c7110d576b5a tempest-SnapshotDependencyTests-1299266856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:39 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187 Sep 21 12:07:39 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:39 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a59239a8-938e-442b-a717-c7110d576b5a tempest-SnapshotDependencyTests-1299266856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187" returned: 0 in 0.570s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a59239a8-938e-442b-a717-c7110d576b5a tempest-SnapshotDependencyTests-1299266856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.28bb447b-0102-48c6-aae2-bfbf5036160e {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:39 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.28bb447b-0102-48c6-aae2-bfbf5036160e Sep 21 12:07:39 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:40 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a59239a8-938e-442b-a717-c7110d576b5a tempest-SnapshotDependencyTests-1299266856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.28bb447b-0102-48c6-aae2-bfbf5036160e" returned: 0 in 0.428s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a59239a8-938e-442b-a717-c7110d576b5a tempest-SnapshotDependencyTests-1299266856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.28bb447b-0102-48c6-aae2-bfbf5036160e {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:40 devstack sudo[102713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.28bb447b-0102-48c6-aae2-bfbf5036160e Sep 21 12:07:40 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:40 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a59239a8-938e-442b-a717-c7110d576b5a tempest-SnapshotDependencyTests-1299266856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187.28bb447b-0102-48c6-aae2-bfbf5036160e" returned: 0 in 0.330s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a59239a8-938e-442b-a717-c7110d576b5a tempest-SnapshotDependencyTests-1299266856 None] Lock "cinder-quobyte-28bb447b-0102-48c6-aae2-bfbf5036160e" released by "_delete_snapshot" :: held 1.806s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:07:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a59239a8-938e-442b-a717-c7110d576b5a tempest-SnapshotDependencyTests-1299266856 None] Lock "cinder-quobyte-dcd8a46b-46ca-4f1c-8f38-ee149be33187" released by "delete_snapshot" :: held 1.834s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:07:40 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-a59239a8-938e-442b-a717-c7110d576b5a tempest-SnapshotDependencyTests-1299266856 None] Created reservations ['811ce7d2-b208-46e0-965a-c67179ce38bf', 'dda9e1b7-8de1-4d5e-8cb5-cd1ffe256700', 'db87865c-7844-4248-a7eb-b75b3937c772', '4a27317e-4fda-4eec-a8f2-fb152b3ac023'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:07:40 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-a59239a8-938e-442b-a717-c7110d576b5a tempest-SnapshotDependencyTests-1299266856 None] Delete snapshot completed successfully. Sep 21 12:07:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a59239a8-938e-442b-a717-c7110d576b5a tempest-SnapshotDependencyTests-1299266856 None] Lock "cinder-28bb447b-0102-48c6-aae2-bfbf5036160e-delete_snapshot" released by "delete_snapshot" :: held 2.016s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:07:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a3ece6ad-dd1a-46ab-bc41-a8a5e264b17a tempest-SnapshotDependencyTests-1299266856 None] Acquiring lock "cinder-dcd8a46b-46ca-4f1c-8f38-ee149be33187-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:07:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a3ece6ad-dd1a-46ab-bc41-a8a5e264b17a tempest-SnapshotDependencyTests-1299266856 None] Lock "cinder-dcd8a46b-46ca-4f1c-8f38-ee149be33187-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:07:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a3ece6ad-dd1a-46ab-bc41-a8a5e264b17a tempest-SnapshotDependencyTests-1299266856 None] Acquiring lock "cinder-quobyte-dcd8a46b-46ca-4f1c-8f38-ee149be33187" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:07:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a3ece6ad-dd1a-46ab-bc41-a8a5e264b17a tempest-SnapshotDependencyTests-1299266856 None] Lock "cinder-quobyte-dcd8a46b-46ca-4f1c-8f38-ee149be33187" acquired by "delete_volume" :: waited 0.018s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:07:41 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bb1d6f-5da8-41fa-96ab-0827d68680e8]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:07:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a3ece6ad-dd1a-46ab-bc41-a8a5e264b17a tempest-SnapshotDependencyTests-1299266856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:41 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-f130ad9e-6135-4618-ac61-eb661a7b3e36 req-f97b11e9-3c18-4c9a-800c-8578d69813d4 tempest-TestStampPattern-1856543467 None] Terminate volume connection completed successfully. Sep 21 12:07:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-f130ad9e-6135-4618-ac61-eb661a7b3e36 req-f97b11e9-3c18-4c9a-800c-8578d69813d4 tempest-TestStampPattern-1856543467 None] Deleting attachment 16391404-a243-4813-aa36-877ad88531ff. {{(pid=86366) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 12:07:41 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187 Sep 21 12:07:41 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:41 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a3ece6ad-dd1a-46ab-bc41-a8a5e264b17a tempest-SnapshotDependencyTests-1299266856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187" returned: 0 in 0.421s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a3ece6ad-dd1a-46ab-bc41-a8a5e264b17a tempest-SnapshotDependencyTests-1299266856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:41 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187 Sep 21 12:07:41 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:41 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a3ece6ad-dd1a-46ab-bc41-a8a5e264b17a tempest-SnapshotDependencyTests-1299266856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-dcd8a46b-46ca-4f1c-8f38-ee149be33187" returned: 0 in 0.294s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:41 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a3ece6ad-dd1a-46ab-bc41-a8a5e264b17a tempest-SnapshotDependencyTests-1299266856 None] Lock "cinder-quobyte-dcd8a46b-46ca-4f1c-8f38-ee149be33187" released by "delete_volume" :: held 0.808s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:07:41 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-a3ece6ad-dd1a-46ab-bc41-a8a5e264b17a tempest-SnapshotDependencyTests-1299266856 None] Created reservations ['c538f5d9-9a55-4755-be13-fa4e11de5d63', 'b14b8ec8-6be6-49fa-b4d1-75d0ceeb73ce', 'dfdaf81f-135a-44d0-95e3-4d8b483b8b6f', '1ac1131a-155e-454a-af6e-eabb6cb5644f'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:07:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a3ece6ad-dd1a-46ab-bc41-a8a5e264b17a tempest-SnapshotDependencyTests-1299266856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:07:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a3ece6ad-dd1a-46ab-bc41-a8a5e264b17a tempest-SnapshotDependencyTests-1299266856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:07:41 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a3ece6ad-dd1a-46ab-bc41-a8a5e264b17a tempest-SnapshotDependencyTests-1299266856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:07:41 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a3ece6ad-dd1a-46ab-bc41-a8a5e264b17a tempest-SnapshotDependencyTests-1299266856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:07:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a3ece6ad-dd1a-46ab-bc41-a8a5e264b17a tempest-SnapshotDependencyTests-1299266856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:07:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a3ece6ad-dd1a-46ab-bc41-a8a5e264b17a tempest-SnapshotDependencyTests-1299266856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:41 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:07:42 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9fed346b-110b-4e44-ae53-c76c949bb01a tempest-SnapshotDependencyTests-1299266856 None] Acquiring lock "cinder-aa816ec0-a54b-45aa-82b4-f218e6281537-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:07:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9fed346b-110b-4e44-ae53-c76c949bb01a tempest-SnapshotDependencyTests-1299266856 None] Lock "cinder-aa816ec0-a54b-45aa-82b4-f218e6281537-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:07:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9fed346b-110b-4e44-ae53-c76c949bb01a tempest-SnapshotDependencyTests-1299266856 None] Acquiring lock "cinder-quobyte-aa816ec0-a54b-45aa-82b4-f218e6281537" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:07:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9fed346b-110b-4e44-ae53-c76c949bb01a tempest-SnapshotDependencyTests-1299266856 None] Lock "cinder-quobyte-aa816ec0-a54b-45aa-82b4-f218e6281537" acquired by "delete_volume" :: waited 0.026s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:07:42 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b26429-9d12-417c-b261-b1fcbdab5d29]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:07:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9fed346b-110b-4e44-ae53-c76c949bb01a tempest-SnapshotDependencyTests-1299266856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-aa816ec0-a54b-45aa-82b4-f218e6281537 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:42 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a3ece6ad-dd1a-46ab-bc41-a8a5e264b17a tempest-SnapshotDependencyTests-1299266856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.368s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:42 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-a3ece6ad-dd1a-46ab-bc41-a8a5e264b17a tempest-SnapshotDependencyTests-1299266856 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:07:42 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-a3ece6ad-dd1a-46ab-bc41-a8a5e264b17a tempest-SnapshotDependencyTests-1299266856 None] Deleted volume successfully. Sep 21 12:07:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-a3ece6ad-dd1a-46ab-bc41-a8a5e264b17a tempest-SnapshotDependencyTests-1299266856 None] Lock "cinder-dcd8a46b-46ca-4f1c-8f38-ee149be33187-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:07:42 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-aa816ec0-a54b-45aa-82b4-f218e6281537 Sep 21 12:07:42 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-70903806-4f99-49ac-a3e4-5a8ba5002b0a req-b3288431-7500-4ed9-a90c-295a28a05bc2 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:07:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-70903806-4f99-49ac-a3e4-5a8ba5002b0a req-b3288431-7500-4ed9-a90c-295a28a05bc2 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:07:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-70903806-4f99-49ac-a3e4-5a8ba5002b0a req-b3288431-7500-4ed9-a90c-295a28a05bc2 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:07:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-70903806-4f99-49ac-a3e4-5a8ba5002b0a req-b3288431-7500-4ed9-a90c-295a28a05bc2 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d', 'name': 'volume-d0ba1165-dd69-4ac3-b941-9da2b7e821f2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e6676b9-667f-42b4-963b-5a0a3657516f', 'enforce_multipath': True} {{(pid=86366) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 12:07:42 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-70903806-4f99-49ac-a3e4-5a8ba5002b0a req-b3288431-7500-4ed9-a90c-295a28a05bc2 tempest-TestServerVolumeAttachmentScenario-1801514564 None] attachment_update completed successfully. Sep 21 12:07:42 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9fed346b-110b-4e44-ae53-c76c949bb01a tempest-SnapshotDependencyTests-1299266856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-aa816ec0-a54b-45aa-82b4-f218e6281537" returned: 0 in 0.507s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9fed346b-110b-4e44-ae53-c76c949bb01a tempest-SnapshotDependencyTests-1299266856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-aa816ec0-a54b-45aa-82b4-f218e6281537 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:42 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-aa816ec0-a54b-45aa-82b4-f218e6281537 Sep 21 12:07:42 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:43 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9fed346b-110b-4e44-ae53-c76c949bb01a tempest-SnapshotDependencyTests-1299266856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-aa816ec0-a54b-45aa-82b4-f218e6281537" returned: 0 in 0.387s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:43 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9fed346b-110b-4e44-ae53-c76c949bb01a tempest-SnapshotDependencyTests-1299266856 None] Lock "cinder-quobyte-aa816ec0-a54b-45aa-82b4-f218e6281537" released by "delete_volume" :: held 0.978s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:07:43 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-9fed346b-110b-4e44-ae53-c76c949bb01a tempest-SnapshotDependencyTests-1299266856 None] Created reservations ['664ab1c9-dfa6-45ea-b654-7f756f8f30c9', 'b6de2d20-1149-4e68-8667-f6ff7bd2cd43', 'ae187bb5-acb7-409f-9220-d9dd1d36762f', '0f120915-9ca0-4322-9b34-0c43c749c28c'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:07:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9fed346b-110b-4e44-ae53-c76c949bb01a tempest-SnapshotDependencyTests-1299266856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:07:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9fed346b-110b-4e44-ae53-c76c949bb01a tempest-SnapshotDependencyTests-1299266856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:07:43 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9fed346b-110b-4e44-ae53-c76c949bb01a tempest-SnapshotDependencyTests-1299266856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:07:43 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9fed346b-110b-4e44-ae53-c76c949bb01a tempest-SnapshotDependencyTests-1299266856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:07:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9fed346b-110b-4e44-ae53-c76c949bb01a tempest-SnapshotDependencyTests-1299266856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:07:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9fed346b-110b-4e44-ae53-c76c949bb01a tempest-SnapshotDependencyTests-1299266856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:43 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:07:43 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:43 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9fed346b-110b-4e44-ae53-c76c949bb01a tempest-SnapshotDependencyTests-1299266856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.369s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:43 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-9fed346b-110b-4e44-ae53-c76c949bb01a tempest-SnapshotDependencyTests-1299266856 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:07:43 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-9fed346b-110b-4e44-ae53-c76c949bb01a tempest-SnapshotDependencyTests-1299266856 None] Deleted volume successfully. Sep 21 12:07:43 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9fed346b-110b-4e44-ae53-c76c949bb01a tempest-SnapshotDependencyTests-1299266856 None] Lock "cinder-aa816ec0-a54b-45aa-82b4-f218e6281537-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:07:45 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-7d374ea9-ce25-4cd8-a7ad-24ca0fa92f51 req-d6db56d9-cf19-49f0-a893-984b7fbc2a93 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Terminate volume connection completed successfully. Sep 21 12:07:45 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-7d374ea9-ce25-4cd8-a7ad-24ca0fa92f51 req-d6db56d9-cf19-49f0-a893-984b7fbc2a93 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Deleting attachment 2e6676b9-667f-42b4-963b-5a0a3657516f. {{(pid=86366) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 12:07:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-d4fdb149-3779-4a34-9827-e36ccff09eb9 tempest-TestStampPattern-1856543467 None] Acquiring lock "cinder-3c9f78bb-ac6d-4154-8c32-16f90511e606-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:07:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-d4fdb149-3779-4a34-9827-e36ccff09eb9 tempest-TestStampPattern-1856543467 None] Lock "cinder-3c9f78bb-ac6d-4154-8c32-16f90511e606-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:07:46 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-d4fdb149-3779-4a34-9827-e36ccff09eb9 tempest-TestStampPattern-1856543467 None] Acquiring lock "cinder-quobyte-3c9f78bb-ac6d-4154-8c32-16f90511e606" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:07:46 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-d4fdb149-3779-4a34-9827-e36ccff09eb9 tempest-TestStampPattern-1856543467 None] Lock "cinder-quobyte-3c9f78bb-ac6d-4154-8c32-16f90511e606" acquired by "delete_volume" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:07:46 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65b90c4-2843-4a8a-a139-73bd529d14f1]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:07:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d4fdb149-3779-4a34-9827-e36ccff09eb9 tempest-TestStampPattern-1856543467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3c9f78bb-ac6d-4154-8c32-16f90511e606 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:46 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3c9f78bb-ac6d-4154-8c32-16f90511e606 Sep 21 12:07:46 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:46 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d4fdb149-3779-4a34-9827-e36ccff09eb9 tempest-TestStampPattern-1856543467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3c9f78bb-ac6d-4154-8c32-16f90511e606" returned: 0 in 0.385s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d4fdb149-3779-4a34-9827-e36ccff09eb9 tempest-TestStampPattern-1856543467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3c9f78bb-ac6d-4154-8c32-16f90511e606 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:46 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3c9f78bb-ac6d-4154-8c32-16f90511e606 Sep 21 12:07:46 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:46 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d4fdb149-3779-4a34-9827-e36ccff09eb9 tempest-TestStampPattern-1856543467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3c9f78bb-ac6d-4154-8c32-16f90511e606" returned: 0 in 0.310s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:46 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-d4fdb149-3779-4a34-9827-e36ccff09eb9 tempest-TestStampPattern-1856543467 None] Lock "cinder-quobyte-3c9f78bb-ac6d-4154-8c32-16f90511e606" released by "delete_volume" :: held 0.743s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:07:46 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-d4fdb149-3779-4a34-9827-e36ccff09eb9 tempest-TestStampPattern-1856543467 None] Created reservations ['de49a6bd-c4c0-40ed-939a-3bdbeb4ca0e8', '631f0cdf-c763-4e0d-93de-264079e2d2c6', '8f9a2b9f-fdae-42e1-9aa3-15921f08a611', '8b5d3a49-3fdd-4fb0-a7b3-a1d4411b9216'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:07:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d4fdb149-3779-4a34-9827-e36ccff09eb9 tempest-TestStampPattern-1856543467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:07:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d4fdb149-3779-4a34-9827-e36ccff09eb9 tempest-TestStampPattern-1856543467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:07:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d4fdb149-3779-4a34-9827-e36ccff09eb9 tempest-TestStampPattern-1856543467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:07:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d4fdb149-3779-4a34-9827-e36ccff09eb9 tempest-TestStampPattern-1856543467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:07:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d4fdb149-3779-4a34-9827-e36ccff09eb9 tempest-TestStampPattern-1856543467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:07:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d4fdb149-3779-4a34-9827-e36ccff09eb9 tempest-TestStampPattern-1856543467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:47 devstack sudo[102796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:07:47 devstack sudo[102796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:47 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-c117c243-7d4d-4b8f-8525-cd477a9f213b req-0d785900-d2d3-45b3-8ac4-a1ebb3d3c751 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Terminate volume connection completed successfully. Sep 21 12:07:47 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-c117c243-7d4d-4b8f-8525-cd477a9f213b req-0d785900-d2d3-45b3-8ac4-a1ebb3d3c751 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Deleting attachment 960af034-0241-41cb-a995-e67db37f32ec. {{(pid=86366) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 12:07:47 devstack sudo[102796]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d4fdb149-3779-4a34-9827-e36ccff09eb9 tempest-TestStampPattern-1856543467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.326s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:47 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-d4fdb149-3779-4a34-9827-e36ccff09eb9 tempest-TestStampPattern-1856543467 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:07:47 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-d4fdb149-3779-4a34-9827-e36ccff09eb9 tempest-TestStampPattern-1856543467 None] Deleted volume successfully. Sep 21 12:07:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-d4fdb149-3779-4a34-9827-e36ccff09eb9 tempest-TestStampPattern-1856543467 None] Lock "cinder-3c9f78bb-ac6d-4154-8c32-16f90511e606-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:07:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2addff69-d887-4c50-a989-087d1d1c1e98 tempest-TestStampPattern-1856543467 None] Acquiring lock "cinder-d7981b4b-ad21-4ecc-b2ea-57e475074452-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:07:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2addff69-d887-4c50-a989-087d1d1c1e98 tempest-TestStampPattern-1856543467 None] Lock "cinder-d7981b4b-ad21-4ecc-b2ea-57e475074452-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:07:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2addff69-d887-4c50-a989-087d1d1c1e98 tempest-TestStampPattern-1856543467 None] Acquiring lock "cinder-quobyte-241e3e59-081b-4241-b3de-75aafd49db55" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:07:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2addff69-d887-4c50-a989-087d1d1c1e98 tempest-TestStampPattern-1856543467 None] Lock "cinder-quobyte-241e3e59-081b-4241-b3de-75aafd49db55" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:07:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2addff69-d887-4c50-a989-087d1d1c1e98 tempest-TestStampPattern-1856543467 None] Acquiring lock "cinder-quobyte-d7981b4b-ad21-4ecc-b2ea-57e475074452" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:07:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2addff69-d887-4c50-a989-087d1d1c1e98 tempest-TestStampPattern-1856543467 None] Lock "cinder-quobyte-d7981b4b-ad21-4ecc-b2ea-57e475074452" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:07:47 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-2addff69-d887-4c50-a989-087d1d1c1e98 tempest-TestStampPattern-1856543467 None] Deleting offline snapshot d7981b4b-ad21-4ecc-b2ea-57e475074452 of volume 241e3e59-081b-4241-b3de-75aafd49db55 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:07:47 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-2addff69-d887-4c50-a989-087d1d1c1e98 tempest-TestStampPattern-1856543467 None] snapshot_file for this snap is: volume-241e3e59-081b-4241-b3de-75aafd49db55.d7981b4b-ad21-4ecc-b2ea-57e475074452 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:07:47 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4bf690-0eab-416e-a853-ee6e29b5d8ad]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:07:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2addff69-d887-4c50-a989-087d1d1c1e98 tempest-TestStampPattern-1856543467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.d7981b4b-ad21-4ecc-b2ea-57e475074452 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:47 devstack sudo[102822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.d7981b4b-ad21-4ecc-b2ea-57e475074452 Sep 21 12:07:47 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:48 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2addff69-d887-4c50-a989-087d1d1c1e98 tempest-TestStampPattern-1856543467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.d7981b4b-ad21-4ecc-b2ea-57e475074452" returned: 0 in 0.504s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:48 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-2addff69-d887-4c50-a989-087d1d1c1e98 tempest-TestStampPattern-1856543467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-241e3e59-081b-4241-b3de-75aafd49db55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:07:48 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90186db-16a2-47a6-a7ea-f9ef00fd275e]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:07:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2addff69-d887-4c50-a989-087d1d1c1e98 tempest-TestStampPattern-1856543467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:48 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55 Sep 21 12:07:48 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:48 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2addff69-d887-4c50-a989-087d1d1c1e98 tempest-TestStampPattern-1856543467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55" returned: 0 in 0.798s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2addff69-d887-4c50-a989-087d1d1c1e98 tempest-TestStampPattern-1856543467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.d7981b4b-ad21-4ecc-b2ea-57e475074452 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:49 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.d7981b4b-ad21-4ecc-b2ea-57e475074452 Sep 21 12:07:49 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:49 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2addff69-d887-4c50-a989-087d1d1c1e98 tempest-TestStampPattern-1856543467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.d7981b4b-ad21-4ecc-b2ea-57e475074452" returned: 0 in 0.468s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2addff69-d887-4c50-a989-087d1d1c1e98 tempest-TestStampPattern-1856543467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.d7981b4b-ad21-4ecc-b2ea-57e475074452 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:49 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.d7981b4b-ad21-4ecc-b2ea-57e475074452 Sep 21 12:07:49 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:49 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2addff69-d887-4c50-a989-087d1d1c1e98 tempest-TestStampPattern-1856543467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55.d7981b4b-ad21-4ecc-b2ea-57e475074452" returned: 0 in 0.338s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2addff69-d887-4c50-a989-087d1d1c1e98 tempest-TestStampPattern-1856543467 None] Lock "cinder-quobyte-d7981b4b-ad21-4ecc-b2ea-57e475074452" released by "_delete_snapshot" :: held 2.275s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:07:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2addff69-d887-4c50-a989-087d1d1c1e98 tempest-TestStampPattern-1856543467 None] Lock "cinder-quobyte-241e3e59-081b-4241-b3de-75aafd49db55" released by "delete_snapshot" :: held 2.300s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:07:49 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-2addff69-d887-4c50-a989-087d1d1c1e98 tempest-TestStampPattern-1856543467 None] Created reservations ['7b818652-46cc-4393-a5b9-edb60d3b66ff', '0cce4262-5ea3-49bf-ac23-9192cf8e3ec7', '922434aa-3b8f-4e74-affa-d57eecefc0b5', '37f2aafa-caa6-47a2-bd47-c72ec7e55e85'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:07:49 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-2addff69-d887-4c50-a989-087d1d1c1e98 tempest-TestStampPattern-1856543467 None] Delete snapshot completed successfully. Sep 21 12:07:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2addff69-d887-4c50-a989-087d1d1c1e98 tempest-TestStampPattern-1856543467 None] Lock "cinder-d7981b4b-ad21-4ecc-b2ea-57e475074452-delete_snapshot" released by "delete_snapshot" :: held 2.468s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:07:52 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b0b2b069-57da-4d0d-af4e-bdc801c9d8e2 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Acquiring lock "cinder-d0ba1165-dd69-4ac3-b941-9da2b7e821f2-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:07:52 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b0b2b069-57da-4d0d-af4e-bdc801c9d8e2 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Lock "cinder-d0ba1165-dd69-4ac3-b941-9da2b7e821f2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:07:52 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b0b2b069-57da-4d0d-af4e-bdc801c9d8e2 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Acquiring lock "cinder-quobyte-d0ba1165-dd69-4ac3-b941-9da2b7e821f2" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:07:52 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b0b2b069-57da-4d0d-af4e-bdc801c9d8e2 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Lock "cinder-quobyte-d0ba1165-dd69-4ac3-b941-9da2b7e821f2" acquired by "delete_volume" :: waited 0.021s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:07:52 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[960f08ab-e6df-4af0-a536-01dab31af9a0]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:07:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b0b2b069-57da-4d0d-af4e-bdc801c9d8e2 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d0ba1165-dd69-4ac3-b941-9da2b7e821f2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:53 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d0ba1165-dd69-4ac3-b941-9da2b7e821f2 Sep 21 12:07:53 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:53 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b0b2b069-57da-4d0d-af4e-bdc801c9d8e2 tempest-TestServerVolumeAttachmentScenario-1801514564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d0ba1165-dd69-4ac3-b941-9da2b7e821f2" returned: 0 in 0.506s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b0b2b069-57da-4d0d-af4e-bdc801c9d8e2 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d0ba1165-dd69-4ac3-b941-9da2b7e821f2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:53 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d0ba1165-dd69-4ac3-b941-9da2b7e821f2 Sep 21 12:07:53 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:53 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b0b2b069-57da-4d0d-af4e-bdc801c9d8e2 tempest-TestServerVolumeAttachmentScenario-1801514564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d0ba1165-dd69-4ac3-b941-9da2b7e821f2" returned: 0 in 0.341s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b0b2b069-57da-4d0d-af4e-bdc801c9d8e2 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Lock "cinder-quobyte-d0ba1165-dd69-4ac3-b941-9da2b7e821f2" released by "delete_volume" :: held 0.899s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:07:53 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-b0b2b069-57da-4d0d-af4e-bdc801c9d8e2 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Created reservations ['e5d542cc-5b10-4454-b9f9-45356af3d899', '34b97ad7-224b-4b02-aef8-ad5c896cf43d', 'a7867a36-5f87-4a3b-8931-db9efe0bdc71', '19ef3c79-30c5-4230-b53e-5c93f6f9a21e'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:07:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b0b2b069-57da-4d0d-af4e-bdc801c9d8e2 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:07:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b0b2b069-57da-4d0d-af4e-bdc801c9d8e2 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:07:54 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b0b2b069-57da-4d0d-af4e-bdc801c9d8e2 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:07:54 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b0b2b069-57da-4d0d-af4e-bdc801c9d8e2 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:07:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b0b2b069-57da-4d0d-af4e-bdc801c9d8e2 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:07:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b0b2b069-57da-4d0d-af4e-bdc801c9d8e2 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:54 devstack sudo[102902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:07:54 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4c8afaff-b5b0-4b33-90df-053800afb2ff tempest-TestServerVolumeAttachmentScenario-1801514564 None] Acquiring lock "cinder-3b0ede80-4a64-4fbc-9f83-94b9ae2e2001-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:07:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4c8afaff-b5b0-4b33-90df-053800afb2ff tempest-TestServerVolumeAttachmentScenario-1801514564 None] Lock "cinder-3b0ede80-4a64-4fbc-9f83-94b9ae2e2001-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:07:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4c8afaff-b5b0-4b33-90df-053800afb2ff tempest-TestServerVolumeAttachmentScenario-1801514564 None] Acquiring lock "cinder-quobyte-3b0ede80-4a64-4fbc-9f83-94b9ae2e2001" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:07:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4c8afaff-b5b0-4b33-90df-053800afb2ff tempest-TestServerVolumeAttachmentScenario-1801514564 None] Lock "cinder-quobyte-3b0ede80-4a64-4fbc-9f83-94b9ae2e2001" acquired by "delete_volume" :: waited 0.024s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:07:54 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f29950-09c6-4cec-82d7-98eee989def2]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:07:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4c8afaff-b5b0-4b33-90df-053800afb2ff tempest-TestServerVolumeAttachmentScenario-1801514564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3b0ede80-4a64-4fbc-9f83-94b9ae2e2001 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:54 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b0b2b069-57da-4d0d-af4e-bdc801c9d8e2 tempest-TestServerVolumeAttachmentScenario-1801514564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.298s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:54 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-b0b2b069-57da-4d0d-af4e-bdc801c9d8e2 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:07:54 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3b0ede80-4a64-4fbc-9f83-94b9ae2e2001 Sep 21 12:07:54 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:54 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-b0b2b069-57da-4d0d-af4e-bdc801c9d8e2 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Deleted volume successfully. Sep 21 12:07:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b0b2b069-57da-4d0d-af4e-bdc801c9d8e2 tempest-TestServerVolumeAttachmentScenario-1801514564 None] Lock "cinder-d0ba1165-dd69-4ac3-b941-9da2b7e821f2-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:07:54 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4c8afaff-b5b0-4b33-90df-053800afb2ff tempest-TestServerVolumeAttachmentScenario-1801514564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3b0ede80-4a64-4fbc-9f83-94b9ae2e2001" returned: 0 in 0.418s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4c8afaff-b5b0-4b33-90df-053800afb2ff tempest-TestServerVolumeAttachmentScenario-1801514564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3b0ede80-4a64-4fbc-9f83-94b9ae2e2001 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:54 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3b0ede80-4a64-4fbc-9f83-94b9ae2e2001 Sep 21 12:07:54 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-63264627-238c-4574-b431-fa9e97a50d73 tempest-TestStampPattern-1856543467 None] Acquiring lock "cinder-241e3e59-081b-4241-b3de-75aafd49db55-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:07:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-63264627-238c-4574-b431-fa9e97a50d73 tempest-TestStampPattern-1856543467 None] Lock "cinder-241e3e59-081b-4241-b3de-75aafd49db55-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:07:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-63264627-238c-4574-b431-fa9e97a50d73 tempest-TestStampPattern-1856543467 None] Acquiring lock "cinder-quobyte-241e3e59-081b-4241-b3de-75aafd49db55" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:07:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-63264627-238c-4574-b431-fa9e97a50d73 tempest-TestStampPattern-1856543467 None] Lock "cinder-quobyte-241e3e59-081b-4241-b3de-75aafd49db55" acquired by "delete_volume" :: waited 0.021s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:07:54 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[31dca761-b6b2-48de-af21-053d3707f64c]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:07:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-63264627-238c-4574-b431-fa9e97a50d73 tempest-TestStampPattern-1856543467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:54 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55 Sep 21 12:07:54 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:55 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4c8afaff-b5b0-4b33-90df-053800afb2ff tempest-TestServerVolumeAttachmentScenario-1801514564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3b0ede80-4a64-4fbc-9f83-94b9ae2e2001" returned: 0 in 0.405s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4c8afaff-b5b0-4b33-90df-053800afb2ff tempest-TestServerVolumeAttachmentScenario-1801514564 None] Lock "cinder-quobyte-3b0ede80-4a64-4fbc-9f83-94b9ae2e2001" released by "delete_volume" :: held 0.876s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:07:55 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-4c8afaff-b5b0-4b33-90df-053800afb2ff tempest-TestServerVolumeAttachmentScenario-1801514564 None] Created reservations ['6dad290f-0eb5-41d4-ad27-c6a9c8253958', 'a76bc071-e0a6-44a5-8220-7159b2428431', 'f67dbabb-b80a-4e37-86b1-5a9a61196636', '77588a9f-cb57-4099-982c-3ac4a0208adf'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:07:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4c8afaff-b5b0-4b33-90df-053800afb2ff tempest-TestServerVolumeAttachmentScenario-1801514564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:07:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4c8afaff-b5b0-4b33-90df-053800afb2ff tempest-TestServerVolumeAttachmentScenario-1801514564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:07:55 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4c8afaff-b5b0-4b33-90df-053800afb2ff tempest-TestServerVolumeAttachmentScenario-1801514564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:07:55 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4c8afaff-b5b0-4b33-90df-053800afb2ff tempest-TestServerVolumeAttachmentScenario-1801514564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:07:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4c8afaff-b5b0-4b33-90df-053800afb2ff tempest-TestServerVolumeAttachmentScenario-1801514564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:07:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4c8afaff-b5b0-4b33-90df-053800afb2ff tempest-TestServerVolumeAttachmentScenario-1801514564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:55 devstack sudo[102920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:07:55 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:55 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-63264627-238c-4574-b431-fa9e97a50d73 tempest-TestStampPattern-1856543467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55" returned: 0 in 0.461s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-63264627-238c-4574-b431-fa9e97a50d73 tempest-TestStampPattern-1856543467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:55 devstack sudo[102922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55 Sep 21 12:07:55 devstack sudo[102922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:55 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4c8afaff-b5b0-4b33-90df-053800afb2ff tempest-TestServerVolumeAttachmentScenario-1801514564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.336s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:55 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-4c8afaff-b5b0-4b33-90df-053800afb2ff tempest-TestServerVolumeAttachmentScenario-1801514564 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:07:55 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-4c8afaff-b5b0-4b33-90df-053800afb2ff tempest-TestServerVolumeAttachmentScenario-1801514564 None] Deleted volume successfully. Sep 21 12:07:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4c8afaff-b5b0-4b33-90df-053800afb2ff tempest-TestServerVolumeAttachmentScenario-1801514564 None] Lock "cinder-3b0ede80-4a64-4fbc-9f83-94b9ae2e2001-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:07:55 devstack sudo[102922]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-63264627-238c-4574-b431-fa9e97a50d73 tempest-TestStampPattern-1856543467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-241e3e59-081b-4241-b3de-75aafd49db55" returned: 0 in 0.341s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-63264627-238c-4574-b431-fa9e97a50d73 tempest-TestStampPattern-1856543467 None] Lock "cinder-quobyte-241e3e59-081b-4241-b3de-75aafd49db55" released by "delete_volume" :: held 0.933s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:07:55 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-63264627-238c-4574-b431-fa9e97a50d73 tempest-TestStampPattern-1856543467 None] Created reservations ['e68c3bc3-6731-4b77-994c-ad8d0ab879cb', '04207151-ee74-49d4-ba5f-9ac82f3c46ef', '857ab001-ab88-4049-b3d4-d34f242fdc92', '3ce1f4cd-c592-4591-a04c-44bc292bc709'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:07:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-63264627-238c-4574-b431-fa9e97a50d73 tempest-TestStampPattern-1856543467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:07:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-63264627-238c-4574-b431-fa9e97a50d73 tempest-TestStampPattern-1856543467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:07:55 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-63264627-238c-4574-b431-fa9e97a50d73 tempest-TestStampPattern-1856543467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:07:55 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-63264627-238c-4574-b431-fa9e97a50d73 tempest-TestStampPattern-1856543467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:07:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-63264627-238c-4574-b431-fa9e97a50d73 tempest-TestStampPattern-1856543467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:07:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-63264627-238c-4574-b431-fa9e97a50d73 tempest-TestStampPattern-1856543467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:07:55 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:07:55 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:07:56 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Sep 21 12:07:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-63264627-238c-4574-b431-fa9e97a50d73 tempest-TestStampPattern-1856543467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.364s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:07:56 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-63264627-238c-4574-b431-fa9e97a50d73 tempest-TestStampPattern-1856543467 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:07:56 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-63264627-238c-4574-b431-fa9e97a50d73 tempest-TestStampPattern-1856543467 None] Deleted volume successfully. Sep 21 12:07:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-63264627-238c-4574-b431-fa9e97a50d73 tempest-TestStampPattern-1856543467 None] Lock "cinder-241e3e59-081b-4241-b3de-75aafd49db55-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:08:03 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 12:08:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:08:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:08:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:03 devstack sudo[102980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:08:03 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:03 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.269s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:03 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:08:03 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 12:08:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread count: 28 {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 12:08:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread info: [<_MainThread(MainThread, started 132841976594560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 12:08:05 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=69,cinder:UPDATE=73,cinder:INSERT=16,cinder:DELETE=2 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:08:06 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=77,cinder:INSERT=19,cinder:UPDATE=70,cinder:DELETE=7 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:08:13 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:08:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Flow 'volume_create_manager' (e22552e0-62da-4325-8315-09d8e06818e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:08:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7651968-4934-43b0-a4df-e501dd504f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7651968-4934-43b0-a4df-e501dd504f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8bb45a6-5c2c-4712-9c26-3105dcf7d982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167a30355da84f098d5ea99280bb4e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:08:14Z,use_quota=True,user_id='bfb7b279b9a8487f8bad7554f189067f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67d5860a-8d56-4af1-9c59-bbd5112a9b82),volume_type_id=67d5860a-8d56-4af1-9c59-bbd5112a9b82)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6936b57b-e688-4cf7-a2e8-ff8d8cb5b33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6936b57b-e688-4cf7-a2e8-ff8d8cb5b33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497ab3e5-1cea-453b-b8f3-3a6419a2b8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:14 devstack cinder-volume[86366]: DEBUG cinder.image.glance [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Creating Keystone auth plugin from conf {{(pid=86366) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 21 12:08:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497ab3e5-1cea-453b-b8f3-3a6419a2b8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c8bb45a6-5c2c-4712-9c26-3105dcf7d982', 'volume_name': 'volume-c8bb45a6-5c2c-4712-9c26-3105dcf7d982', 'volume_size': 1, 'image_id': 'bfae284b-c16b-4230-9e0f-59db1bdff6ba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfae284b-c16b-4230-9e0f-59db1bdff6ba', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '01f0b28a343e08d300b0e941bf58dd08', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '167a30355da84f098d5ea99280bb4e1e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e51422e92a5317bd46b829af642fc3b117590f31110f3b85bf7fa34a50f1204fbd431e1a1c658ad337576d13c59080c31272a0b7b012d8df98170206aff60f97', 'id': 'bfae284b-c16b-4230-9e0f-59db1bdff6ba', 'created_at': datetime.datetime(2026, 9, 21, 10, 8, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 10, 8, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfae284b-c16b-4230-9e0f-59db1bdff6ba/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383ecf85-cbdc-453d-aee4-e077a53f9bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383ecf85-cbdc-453d-aee4-e077a53f9bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61d3673-5967-4123-b031-5d9ca9447cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:14 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Volume c8bb45a6-5c2c-4712-9c26-3105dcf7d982: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c8bb45a6-5c2c-4712-9c26-3105dcf7d982', 'volume_size': 1, 'image_id': 'bfae284b-c16b-4230-9e0f-59db1bdff6ba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfae284b-c16b-4230-9e0f-59db1bdff6ba', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '01f0b28a343e08d300b0e941bf58dd08', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '167a30355da84f098d5ea99280bb4e1e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e51422e92a5317bd46b829af642fc3b117590f31110f3b85bf7fa34a50f1204fbd431e1a1c658ad337576d13c59080c31272a0b7b012d8df98170206aff60f97', 'id': 'bfae284b-c16b-4230-9e0f-59db1bdff6ba', 'created_at': datetime.datetime(2026, 9, 21, 10, 8, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 10, 8, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfae284b-c16b-4230-9e0f-59db1bdff6ba/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 21 12:08:14 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Trying to clone c8bb45a6-5c2c-4712-9c26-3105dcf7d982 from image bfae284b-c16b-4230-9e0f-59db1bdff6ba at location (None, [{'url': 'file:///opt/stack/data/glance/images/bfae284b-c16b-4230-9e0f-59db1bdff6ba', 'metadata': {}}]). {{(pid=86366) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 21 12:08:14 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bfae284b-c16b-4230-9e0f-59db1bdff6ba_mj1x6az8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 21 12:08:14 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Image download 0.00 MB at 0.00 MB/s Sep 21 12:08:14 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[93792bba-af35-48f8-b109-d418ece9597e]: (4, 'raw') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:08:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfae284b-c16b-4230-9e0f-59db1bdff6ba_mj1x6az8devstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:14 devstack sudo[102987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfae284b-c16b-4230-9e0f-59db1bdff6ba_mj1x6az8devstack@QuobyteHD Sep 21 12:08:14 devstack sudo[102987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:14 devstack sudo[102987]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfae284b-c16b-4230-9e0f-59db1bdff6ba_mj1x6az8devstack@QuobyteHD" returned: 0 in 0.431s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfae284b-c16b-4230-9e0f-59db1bdff6ba_mj1x6az8devstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:15 devstack sudo[102991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfae284b-c16b-4230-9e0f-59db1bdff6ba_mj1x6az8devstack@QuobyteHD Sep 21 12:08:15 devstack sudo[102991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:15 devstack sudo[102991]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfae284b-c16b-4230-9e0f-59db1bdff6ba_mj1x6az8devstack@QuobyteHD" returned: 1 in 0.344s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfae284b-c16b-4230-9e0f-59db1bdff6ba_mj1x6az8devstack@QuobyteHD' failed. Not Retrying. {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 12:08:15 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Temporary image bfae284b-c16b-4230-9e0f-59db1bdff6ba is fetched for user bfb7b279b9a8487f8bad7554f189067f. {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 21 12:08:15 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ff094e-80a9-4bac-98ff-0d5d05463a5b]: (4, 'raw') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:08:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfae284b-c16b-4230-9e0f-59db1bdff6ba_mj1x6az8devstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:15 devstack sudo[102996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfae284b-c16b-4230-9e0f-59db1bdff6ba_mj1x6az8devstack@QuobyteHD Sep 21 12:08:15 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:15 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfae284b-c16b-4230-9e0f-59db1bdff6ba_mj1x6az8devstack@QuobyteHD" returned: 0 in 0.357s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfae284b-c16b-4230-9e0f-59db1bdff6ba_mj1x6az8devstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:15 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfae284b-c16b-4230-9e0f-59db1bdff6ba_mj1x6az8devstack@QuobyteHD Sep 21 12:08:15 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:16 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfae284b-c16b-4230-9e0f-59db1bdff6ba_mj1x6az8devstack@QuobyteHD" returned: 1 in 0.408s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfae284b-c16b-4230-9e0f-59db1bdff6ba_mj1x6az8devstack@QuobyteHD' failed. Not Retrying. {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 12:08:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8bb45a6-5c2c-4712-9c26-3105dcf7d982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='167a30355da84f098d5ea99280bb4e1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:08:14Z,use_quota=True,user_id='bfb7b279b9a8487f8bad7554f189067f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67d5860a-8d56-4af1-9c59-bbd5112a9b82),volume_type_id=67d5860a-8d56-4af1-9c59-bbd5112a9b82)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:08:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Creating volume c8bb45a6-5c2c-4712-9c26-3105dcf7d982 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:08:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:08:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:08:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:08:16 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:08:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c8bb45a6-5c2c-4712-9c26-3105dcf7d982 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:16 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c8bb45a6-5c2c-4712-9c26-3105dcf7d982 1073741824 Sep 21 12:08:16 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:16 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c8bb45a6-5c2c-4712-9c26-3105dcf7d982 1073741824" returned: 0 in 0.637s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c8bb45a6-5c2c-4712-9c26-3105dcf7d982 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:16 devstack sudo[103010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c8bb45a6-5c2c-4712-9c26-3105dcf7d982 Sep 21 12:08:16 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:17 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c8bb45a6-5c2c-4712-9c26-3105dcf7d982" returned: 0 in 0.314s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:17 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:08:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:17 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Attempting download of bfae284b-c16b-4230-9e0f-59db1bdff6ba ((None, [{'url': 'file:///opt/stack/data/glance/images/bfae284b-c16b-4230-9e0f-59db1bdff6ba', 'metadata': {}}])) to volume c8bb45a6-5c2c-4712-9c26-3105dcf7d982. {{(pid=86366) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 21 12:08:17 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ca2e84-0799-4e71-a45d-1df20504917b]: (4, 'raw') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:08:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfae284b-c16b-4230-9e0f-59db1bdff6ba_zwtlpgqf {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:17 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfae284b-c16b-4230-9e0f-59db1bdff6ba_zwtlpgqf Sep 21 12:08:17 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:17 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfae284b-c16b-4230-9e0f-59db1bdff6ba_zwtlpgqf" returned: 0 in 0.400s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfae284b-c16b-4230-9e0f-59db1bdff6ba_zwtlpgqf {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:17 devstack sudo[103017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfae284b-c16b-4230-9e0f-59db1bdff6ba_zwtlpgqf Sep 21 12:08:17 devstack sudo[103017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:18 devstack sudo[103017]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfae284b-c16b-4230-9e0f-59db1bdff6ba_zwtlpgqf" returned: 1 in 0.419s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfae284b-c16b-4230-9e0f-59db1bdff6ba_zwtlpgqf' failed. Not Retrying. {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 12:08:18 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[712b88ff-ac45-4006-b6c2-fc0756dd4a02]: (4, 'raw') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:08:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfae284b-c16b-4230-9e0f-59db1bdff6ba_mj1x6az8devstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:18 devstack sudo[103021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfae284b-c16b-4230-9e0f-59db1bdff6ba_mj1x6az8devstack@QuobyteHD Sep 21 12:08:18 devstack sudo[103021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:18 devstack sudo[103021]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bfae284b-c16b-4230-9e0f-59db1bdff6ba_mj1x6az8devstack@QuobyteHD" returned: 0 in 0.467s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfae284b-c16b-4230-9e0f-59db1bdff6ba_mj1x6az8devstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:18 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfae284b-c16b-4230-9e0f-59db1bdff6ba_mj1x6az8devstack@QuobyteHD Sep 21 12:08:18 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:18 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfae284b-c16b-4230-9e0f-59db1bdff6ba_mj1x6az8devstack@QuobyteHD" returned: 1 in 0.350s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bfae284b-c16b-4230-9e0f-59db1bdff6ba_mj1x6az8devstack@QuobyteHD' failed. Not Retrying. {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 12:08:18 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] bfae284b-c16b-4230-9e0f-59db1bdff6ba was raw, converting to qcow2 {{(pid=86366) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 21 12:08:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bfae284b-c16b-4230-9e0f-59db1bdff6ba_mj1x6az8devstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c8bb45a6-5c2c-4712-9c26-3105dcf7d982 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:18 devstack sudo[103031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bfae284b-c16b-4230-9e0f-59db1bdff6ba_mj1x6az8devstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c8bb45a6-5c2c-4712-9c26-3105dcf7d982 Sep 21 12:08:18 devstack sudo[103031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:19 devstack sudo[103031]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bfae284b-c16b-4230-9e0f-59db1bdff6ba_mj1x6az8devstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c8bb45a6-5c2c-4712-9c26-3105dcf7d982" returned: 0 in 0.490s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:19 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bfae284b-c16b-4230-9e0f-59db1bdff6ba_mj1x6az8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c8bb45a6-5c2c-4712-9c26-3105dcf7d982 {{(pid=86366) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 12:08:19 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Converted 0.00 MB image at 0.00 MB/s Sep 21 12:08:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c8bb45a6-5c2c-4712-9c26-3105dcf7d982 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:19 devstack sudo[103037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c8bb45a6-5c2c-4712-9c26-3105dcf7d982 1G Sep 21 12:08:19 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:19 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c8bb45a6-5c2c-4712-9c26-3105dcf7d982 1G" returned: 0 in 0.341s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:19 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Downloaded image bfae284b-c16b-4230-9e0f-59db1bdff6ba ((None, [{'url': 'file:///opt/stack/data/glance/images/bfae284b-c16b-4230-9e0f-59db1bdff6ba', 'metadata': {}}])) to volume c8bb45a6-5c2c-4712-9c26-3105dcf7d982 successfully. {{(pid=86366) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 21 12:08:19 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Temporary image bfae284b-c16b-4230-9e0f-59db1bdff6ba for user bfb7b279b9a8487f8bad7554f189067f is deleted. {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 21 12:08:19 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Marking volume c8bb45a6-5c2c-4712-9c26-3105dcf7d982 as bootable. {{(pid=86366) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 21 12:08:19 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Copying metadata from image bfae284b-c16b-4230-9e0f-59db1bdff6ba to c8bb45a6-5c2c-4712-9c26-3105dcf7d982. {{(pid=86366) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 21 12:08:19 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Creating volume glance metadata for volume c8bb45a6-5c2c-4712-9c26-3105dcf7d982 backed by image bfae284b-c16b-4230-9e0f-59db1bdff6ba with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'bfae284b-c16b-4230-9e0f-59db1bdff6ba', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '01f0b28a343e08d300b0e941bf58dd08', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86366) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 21 12:08:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61d3673-5967-4123-b031-5d9ca9447cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8bb45a6-5c2c-4712-9c26-3105dcf7d982', 'volume_size': 1, 'image_id': 'bfae284b-c16b-4230-9e0f-59db1bdff6ba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfae284b-c16b-4230-9e0f-59db1bdff6ba', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '01f0b28a343e08d300b0e941bf58dd08', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '167a30355da84f098d5ea99280bb4e1e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e51422e92a5317bd46b829af642fc3b117590f31110f3b85bf7fa34a50f1204fbd431e1a1c658ad337576d13c59080c31272a0b7b012d8df98170206aff60f97', 'id': 'bfae284b-c16b-4230-9e0f-59db1bdff6ba', 'created_at': datetime.datetime(2026, 9, 21, 10, 8, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 10, 8, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfae284b-c16b-4230-9e0f-59db1bdff6ba/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90bfd137-fd7a-476d-af3e-d122395bd223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:19 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Volume volume-c8bb45a6-5c2c-4712-9c26-3105dcf7d982 (c8bb45a6-5c2c-4712-9c26-3105dcf7d982): created successfully Sep 21 12:08:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90bfd137-fd7a-476d-af3e-d122395bd223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Flow 'volume_create_manager' (e22552e0-62da-4325-8315-09d8e06818e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:08:19 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-318c8ac8-9b32-429b-9495-764ca711f65f tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Created volume successfully. Sep 21 12:08:20 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-82f38218-d249-4d7f-963f-ad157d0fec33 tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Acquiring lock "cinder-c8bb45a6-5c2c-4712-9c26-3105dcf7d982-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:08:20 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-82f38218-d249-4d7f-963f-ad157d0fec33 tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Lock "cinder-c8bb45a6-5c2c-4712-9c26-3105dcf7d982-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:08:20 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-82f38218-d249-4d7f-963f-ad157d0fec33 tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Acquiring lock "cinder-quobyte-c8bb45a6-5c2c-4712-9c26-3105dcf7d982" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:08:20 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-82f38218-d249-4d7f-963f-ad157d0fec33 tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Lock "cinder-quobyte-c8bb45a6-5c2c-4712-9c26-3105dcf7d982" acquired by "delete_volume" :: waited 0.018s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:08:20 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdd6829-a0d8-421d-b6c6-532bf8df305a]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:08:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-82f38218-d249-4d7f-963f-ad157d0fec33 tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c8bb45a6-5c2c-4712-9c26-3105dcf7d982 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:20 devstack sudo[103042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c8bb45a6-5c2c-4712-9c26-3105dcf7d982 Sep 21 12:08:20 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:20 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-82f38218-d249-4d7f-963f-ad157d0fec33 tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c8bb45a6-5c2c-4712-9c26-3105dcf7d982" returned: 0 in 0.398s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-82f38218-d249-4d7f-963f-ad157d0fec33 tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c8bb45a6-5c2c-4712-9c26-3105dcf7d982 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:20 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c8bb45a6-5c2c-4712-9c26-3105dcf7d982 Sep 21 12:08:20 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:21 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-82f38218-d249-4d7f-963f-ad157d0fec33 tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c8bb45a6-5c2c-4712-9c26-3105dcf7d982" returned: 0 in 0.271s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-82f38218-d249-4d7f-963f-ad157d0fec33 tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Lock "cinder-quobyte-c8bb45a6-5c2c-4712-9c26-3105dcf7d982" released by "delete_volume" :: held 0.718s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:08:21 devstack cinder-volume[86366]: WARNING cinder.quota [None req-82f38218-d249-4d7f-963f-ad157d0fec33 tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 21 12:08:21 devstack cinder-volume[86366]: WARNING cinder.quota [None req-82f38218-d249-4d7f-963f-ad157d0fec33 tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 21 12:08:21 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-82f38218-d249-4d7f-963f-ad157d0fec33 tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Created reservations ['8d74644d-0b41-4f46-b7e1-4aeb1823d65a', 'a7672ad7-3085-4a37-9e79-c52bcaaed666', 'db8950d4-f579-4225-a7fa-772648161743', '840018ce-9df1-4603-b5ca-94418295486c'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:08:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-82f38218-d249-4d7f-963f-ad157d0fec33 tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-82f38218-d249-4d7f-963f-ad157d0fec33 tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:21 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-82f38218-d249-4d7f-963f-ad157d0fec33 tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:08:21 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-82f38218-d249-4d7f-963f-ad157d0fec33 tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:08:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-82f38218-d249-4d7f-963f-ad157d0fec33 tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-82f38218-d249-4d7f-963f-ad157d0fec33 tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:21 devstack sudo[103050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:08:21 devstack sudo[103050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:21 devstack sudo[103050]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-82f38218-d249-4d7f-963f-ad157d0fec33 tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.272s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:21 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-82f38218-d249-4d7f-963f-ad157d0fec33 tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:08:21 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-82f38218-d249-4d7f-963f-ad157d0fec33 tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Deleted volume successfully. Sep 21 12:08:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-82f38218-d249-4d7f-963f-ad157d0fec33 tempest-VolumeAndVolumeTypeFromImageTest-24519439 None] Lock "cinder-c8bb45a6-5c2c-4712-9c26-3105dcf7d982-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:08:26 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:08:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Flow 'volume_create_manager' (1fd0cee8-0264-4b87-93f4-cfeab4b63361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:08:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39423d1-5307-4597-81cf-4a76ba04276e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39423d1-5307-4597-81cf-4a76ba04276e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1135479631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff2acc3b-9f05-44f1-87f3-3a3b6c559081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e7f8ad9cc36480098bb831d7a87f270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:08:27Z,use_quota=True,user_id='7e8b38e56e2241c8a3c5e5336c361868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489a8927-d183-4b3c-955c-81825c283b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489a8927-d183-4b3c-955c-81825c283b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f9dfa6-635a-4f35-b5bc-6a48b6fb2ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f9dfa6-635a-4f35-b5bc-6a48b6fb2ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff2acc3b-9f05-44f1-87f3-3a3b6c559081', 'volume_name': 'volume-ff2acc3b-9f05-44f1-87f3-3a3b6c559081', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb65053d-3f24-4703-b24c-a4b4a756f6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb65053d-3f24-4703-b24c-a4b4a756f6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bff7ade-12cb-410e-ace9-72fa26eb150d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:26 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Volume ff2acc3b-9f05-44f1-87f3-3a3b6c559081: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff2acc3b-9f05-44f1-87f3-3a3b6c559081', 'volume_size': 1} Sep 21 12:08:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:26 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:08:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1135479631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff2acc3b-9f05-44f1-87f3-3a3b6c559081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e7f8ad9cc36480098bb831d7a87f270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:08:27Z,use_quota=True,user_id='7e8b38e56e2241c8a3c5e5336c361868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:08:26 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Creating volume ff2acc3b-9f05-44f1-87f3-3a3b6c559081 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:08:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:26 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:08:26 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:08:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:26 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:08:26 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:08:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ff2acc3b-9f05-44f1-87f3-3a3b6c559081 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:26 devstack sudo[103054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ff2acc3b-9f05-44f1-87f3-3a3b6c559081 1073741824 Sep 21 12:08:26 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Flow 'volume_create_manager' (3bfa6554-3cfd-4f7d-89f8-6e39c871e207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdb38850-5f15-4fb0-a3c7-a2682a9be18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdb38850-5f15-4fb0-a3c7-a2682a9be18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1679157350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43cb2604-1b7d-4f4a-a37c-fe704e12d0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e7f8ad9cc36480098bb831d7a87f270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:08:27Z,use_quota=True,user_id='7e8b38e56e2241c8a3c5e5336c361868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e33a2cfd-5195-4442-a85d-e919784f2170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e33a2cfd-5195-4442-a85d-e919784f2170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e0004b6-2ff2-45a4-89a3-3202553937d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e0004b6-2ff2-45a4-89a3-3202553937d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43cb2604-1b7d-4f4a-a37c-fe704e12d0c0', 'volume_name': 'volume-43cb2604-1b7d-4f4a-a37c-fe704e12d0c0', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed28536-a105-43ad-b783-a5a7018937d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed28536-a105-43ad-b783-a5a7018937d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59aa714d-e303-4cb7-a0db-04f69fba06f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:27 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Volume 43cb2604-1b7d-4f4a-a37c-fe704e12d0c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43cb2604-1b7d-4f4a-a37c-fe704e12d0c0', 'volume_size': 1} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:27 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ff2acc3b-9f05-44f1-87f3-3a3b6c559081 1073741824" returned: 0 in 0.707s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ff2acc3b-9f05-44f1-87f3-3a3b6c559081 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:27 devstack sudo[103060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ff2acc3b-9f05-44f1-87f3-3a3b6c559081 Sep 21 12:08:27 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Flow 'volume_create_manager' (1914b753-b0b5-43a0-931b-1f8e35a7be97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5715c47-d78d-43cc-a696-0d6a3fd1cd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5715c47-d78d-43cc-a696-0d6a3fd1cd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-789198019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80feabf4-224b-4a84-8165-b0f94d027c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e7f8ad9cc36480098bb831d7a87f270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:08:28Z,use_quota=True,user_id='7e8b38e56e2241c8a3c5e5336c361868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f83e04d-d4db-4f99-8cc7-c6198f79869d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f83e04d-d4db-4f99-8cc7-c6198f79869d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f888195-edc8-4eca-b41d-24cd3c758f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f888195-edc8-4eca-b41d-24cd3c758f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80feabf4-224b-4a84-8165-b0f94d027c1b', 'volume_name': 'volume-80feabf4-224b-4a84-8165-b0f94d027c1b', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76626212-5c4a-4c18-a947-b1af56b3c94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76626212-5c4a-4c18-a947-b1af56b3c94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75b6f719-24b3-4b60-af6a-4d3e22c055f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:27 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Volume 80feabf4-224b-4a84-8165-b0f94d027c1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80feabf4-224b-4a84-8165-b0f94d027c1b', 'volume_size': 1} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:27 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ff2acc3b-9f05-44f1-87f3-3a3b6c559081" returned: 0 in 0.323s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.510s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1679157350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43cb2604-1b7d-4f4a-a37c-fe704e12d0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e7f8ad9cc36480098bb831d7a87f270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:08:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:08:27Z,use_quota=True,user_id='7e8b38e56e2241c8a3c5e5336c361868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Creating volume 43cb2604-1b7d-4f4a-a37c-fe704e12d0c0 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:08:27 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-43cb2604-1b7d-4f4a-a37c-fe704e12d0c0 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:27 devstack sudo[103063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-43cb2604-1b7d-4f4a-a37c-fe704e12d0c0 1073741824 Sep 21 12:08:27 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bff7ade-12cb-410e-ace9-72fa26eb150d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff2acc3b-9f05-44f1-87f3-3a3b6c559081', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc91c73b-086b-4a1a-beca-c4c78fb6144b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:27 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Volume volume-ff2acc3b-9f05-44f1-87f3-3a3b6c559081 (ff2acc3b-9f05-44f1-87f3-3a3b6c559081): created successfully Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc91c73b-086b-4a1a-beca-c4c78fb6144b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Flow 'volume_create_manager' (1fd0cee8-0264-4b87-93f4-cfeab4b63361) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:08:27 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-7091f1b6-eaec-481a-9e46-22196d40d5bd tempest-CreateVolumesFromImageTest-40313828 None] Created volume successfully. Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Flow 'volume_create_manager' (84178efb-e857-4aa8-a0b5-ec463bc89c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (729dbc2d-2dfb-4b1c-a2d6-06ae21a3ce7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (729dbc2d-2dfb-4b1c-a2d6-06ae21a3ce7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-105355797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=097a29d4-195e-4a84-a240-0cabbba2b9d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e7f8ad9cc36480098bb831d7a87f270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:08:28Z,use_quota=True,user_id='7e8b38e56e2241c8a3c5e5336c361868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aa87fd9-62d5-46c9-8910-e8ed713bcda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aa87fd9-62d5-46c9-8910-e8ed713bcda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e162bb7-1970-4acd-bf15-bc65ad2f6d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e162bb7-1970-4acd-bf15-bc65ad2f6d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '097a29d4-195e-4a84-a240-0cabbba2b9d0', 'volume_name': 'volume-097a29d4-195e-4a84-a240-0cabbba2b9d0', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0068a72f-3726-4b15-aa45-a4a11726a97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0068a72f-3726-4b15-aa45-a4a11726a97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b1991a-3eac-4e0c-986a-f057e3aff9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:28 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Volume 097a29d4-195e-4a84-a240-0cabbba2b9d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-097a29d4-195e-4a84-a240-0cabbba2b9d0', 'volume_size': 1} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:28 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-43cb2604-1b7d-4f4a-a37c-fe704e12d0c0 1073741824" returned: 0 in 0.616s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-43cb2604-1b7d-4f4a-a37c-fe704e12d0c0 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:28 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-43cb2604-1b7d-4f4a-a37c-fe704e12d0c0 Sep 21 12:08:28 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Flow 'volume_create_manager' (503f3695-4a51-4d9c-8551-3cd79a9b95c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dec61074-5f66-4656-81d5-8cbe057322d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dec61074-5f66-4656-81d5-8cbe057322d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-410888945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dcc9bd2-6e23-406a-a6b3-796f1ef1ede2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e7f8ad9cc36480098bb831d7a87f270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:08:28Z,use_quota=True,user_id='7e8b38e56e2241c8a3c5e5336c361868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d1cdf6-c6bb-4a1b-84d1-4f13d879a71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d1cdf6-c6bb-4a1b-84d1-4f13d879a71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2481f710-641d-4abc-9121-2c369c6074f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2481f710-641d-4abc-9121-2c369c6074f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dcc9bd2-6e23-406a-a6b3-796f1ef1ede2', 'volume_name': 'volume-3dcc9bd2-6e23-406a-a6b3-796f1ef1ede2', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4cf529-ed5d-4de3-b3e0-4432e5b26e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4cf529-ed5d-4de3-b3e0-4432e5b26e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aabf3d40-2d46-420a-a920-df6bdbf2a499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:28 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Volume 3dcc9bd2-6e23-406a-a6b3-796f1ef1ede2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dcc9bd2-6e23-406a-a6b3-796f1ef1ede2', 'volume_size': 1} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:28 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-43cb2604-1b7d-4f4a-a37c-fe704e12d0c0" returned: 0 in 0.266s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.040s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-789198019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80feabf4-224b-4a84-8165-b0f94d027c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e7f8ad9cc36480098bb831d7a87f270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:08:28Z,use_quota=True,user_id='7e8b38e56e2241c8a3c5e5336c361868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Creating volume 80feabf4-224b-4a84-8165-b0f94d027c1b {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:08:28 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-80feabf4-224b-4a84-8165-b0f94d027c1b 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59aa714d-e303-4cb7-a0db-04f69fba06f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43cb2604-1b7d-4f4a-a37c-fe704e12d0c0', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:28 devstack sudo[103074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-80feabf4-224b-4a84-8165-b0f94d027c1b 1073741824 Sep 21 12:08:28 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1110db2-df8f-47db-bc18-3007c6867b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:28 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Volume volume-43cb2604-1b7d-4f4a-a37c-fe704e12d0c0 (43cb2604-1b7d-4f4a-a37c-fe704e12d0c0): created successfully Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1110db2-df8f-47db-bc18-3007c6867b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Flow 'volume_create_manager' (3bfa6554-3cfd-4f7d-89f8-6e39c871e207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:08:28 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-e75fbafe-806d-4569-809e-776a85297844 tempest-CreateVolumesFromImageTest-40313828 None] Created volume successfully. Sep 21 12:08:29 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-80feabf4-224b-4a84-8165-b0f94d027c1b 1073741824" returned: 0 in 0.530s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-80feabf4-224b-4a84-8165-b0f94d027c1b {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:29 devstack sudo[103081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-80feabf4-224b-4a84-8165-b0f94d027c1b Sep 21 12:08:29 devstack sudo[103081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:29 devstack sudo[103081]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-80feabf4-224b-4a84-8165-b0f94d027c1b" returned: 0 in 0.370s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:08:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.527s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-105355797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=097a29d4-195e-4a84-a240-0cabbba2b9d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e7f8ad9cc36480098bb831d7a87f270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:08:28Z,use_quota=True,user_id='7e8b38e56e2241c8a3c5e5336c361868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:08:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Creating volume 097a29d4-195e-4a84-a240-0cabbba2b9d0 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:08:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:08:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:08:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:08:29 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:08:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-097a29d4-195e-4a84-a240-0cabbba2b9d0 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:29 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-097a29d4-195e-4a84-a240-0cabbba2b9d0 1073741824 Sep 21 12:08:29 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75b6f719-24b3-4b60-af6a-4d3e22c055f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80feabf4-224b-4a84-8165-b0f94d027c1b', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (286e2e96-4687-4b30-bf47-7b7f316f5616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:29 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Volume volume-80feabf4-224b-4a84-8165-b0f94d027c1b (80feabf4-224b-4a84-8165-b0f94d027c1b): created successfully Sep 21 12:08:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (286e2e96-4687-4b30-bf47-7b7f316f5616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Flow 'volume_create_manager' (1914b753-b0b5-43a0-931b-1f8e35a7be97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:08:29 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-af26c8e1-eb8c-4131-92c7-16deb67ed604 tempest-CreateVolumesFromImageTest-40313828 None] Created volume successfully. Sep 21 12:08:30 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-097a29d4-195e-4a84-a240-0cabbba2b9d0 1073741824" returned: 0 in 0.488s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-097a29d4-195e-4a84-a240-0cabbba2b9d0 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:30 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-097a29d4-195e-4a84-a240-0cabbba2b9d0 Sep 21 12:08:30 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:30 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-097a29d4-195e-4a84-a240-0cabbba2b9d0" returned: 0 in 0.260s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:30 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:08:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.892s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:30 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-410888945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dcc9bd2-6e23-406a-a6b3-796f1ef1ede2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e7f8ad9cc36480098bb831d7a87f270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:08:28Z,use_quota=True,user_id='7e8b38e56e2241c8a3c5e5336c361868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:08:30 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Creating volume 3dcc9bd2-6e23-406a-a6b3-796f1ef1ede2 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:08:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:30 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:08:30 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:08:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:30 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:08:30 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:08:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3dcc9bd2-6e23-406a-a6b3-796f1ef1ede2 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:30 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3dcc9bd2-6e23-406a-a6b3-796f1ef1ede2 1073741824 Sep 21 12:08:30 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b1991a-3eac-4e0c-986a-f057e3aff9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-097a29d4-195e-4a84-a240-0cabbba2b9d0', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f38b11da-019e-4d12-8eda-15536ba9521e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:30 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Volume volume-097a29d4-195e-4a84-a240-0cabbba2b9d0 (097a29d4-195e-4a84-a240-0cabbba2b9d0): created successfully Sep 21 12:08:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f38b11da-019e-4d12-8eda-15536ba9521e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Flow 'volume_create_manager' (84178efb-e857-4aa8-a0b5-ec463bc89c4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:08:30 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-95578a2f-1fa8-4153-a35b-aa67d1a1a7fe tempest-CreateVolumesFromImageTest-40313828 None] Created volume successfully. Sep 21 12:08:31 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3dcc9bd2-6e23-406a-a6b3-796f1ef1ede2 1073741824" returned: 0 in 0.502s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3dcc9bd2-6e23-406a-a6b3-796f1ef1ede2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:31 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3dcc9bd2-6e23-406a-a6b3-796f1ef1ede2 Sep 21 12:08:31 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:31 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3dcc9bd2-6e23-406a-a6b3-796f1ef1ede2" returned: 0 in 0.247s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:08:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aabf3d40-2d46-420a-a920-df6bdbf2a499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dcc9bd2-6e23-406a-a6b3-796f1ef1ede2', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2620d123-6640-446a-933d-ce63f993ce9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:31 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Volume volume-3dcc9bd2-6e23-406a-a6b3-796f1ef1ede2 (3dcc9bd2-6e23-406a-a6b3-796f1ef1ede2): created successfully Sep 21 12:08:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2620d123-6640-446a-933d-ce63f993ce9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Flow 'volume_create_manager' (503f3695-4a51-4d9c-8551-3cd79a9b95c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:08:31 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-bfc407b3-f9fd-472b-9a32-8660fe4aa5c2 tempest-CreateVolumesFromImageTest-40313828 None] Created volume successfully. Sep 21 12:08:32 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-254c4397-65ce-4944-9f72-1650c7618479 tempest-CreateVolumesFromImageTest-40313828 None] Acquiring lock "cinder-3dcc9bd2-6e23-406a-a6b3-796f1ef1ede2-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:08:32 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-254c4397-65ce-4944-9f72-1650c7618479 tempest-CreateVolumesFromImageTest-40313828 None] Lock "cinder-3dcc9bd2-6e23-406a-a6b3-796f1ef1ede2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:08:32 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-254c4397-65ce-4944-9f72-1650c7618479 tempest-CreateVolumesFromImageTest-40313828 None] Acquiring lock "cinder-quobyte-3dcc9bd2-6e23-406a-a6b3-796f1ef1ede2" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:08:32 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-254c4397-65ce-4944-9f72-1650c7618479 tempest-CreateVolumesFromImageTest-40313828 None] Lock "cinder-quobyte-3dcc9bd2-6e23-406a-a6b3-796f1ef1ede2" acquired by "delete_volume" :: waited 0.021s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:08:32 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef217066-3806-4e40-9636-3cea5ab778cd]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:08:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-254c4397-65ce-4944-9f72-1650c7618479 tempest-CreateVolumesFromImageTest-40313828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3dcc9bd2-6e23-406a-a6b3-796f1ef1ede2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:32 devstack sudo[103102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3dcc9bd2-6e23-406a-a6b3-796f1ef1ede2 Sep 21 12:08:32 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:32 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-254c4397-65ce-4944-9f72-1650c7618479 tempest-CreateVolumesFromImageTest-40313828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3dcc9bd2-6e23-406a-a6b3-796f1ef1ede2" returned: 0 in 0.383s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-254c4397-65ce-4944-9f72-1650c7618479 tempest-CreateVolumesFromImageTest-40313828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3dcc9bd2-6e23-406a-a6b3-796f1ef1ede2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:32 devstack sudo[103107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3dcc9bd2-6e23-406a-a6b3-796f1ef1ede2 Sep 21 12:08:32 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:32 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-254c4397-65ce-4944-9f72-1650c7618479 tempest-CreateVolumesFromImageTest-40313828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3dcc9bd2-6e23-406a-a6b3-796f1ef1ede2" returned: 0 in 0.266s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:32 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-254c4397-65ce-4944-9f72-1650c7618479 tempest-CreateVolumesFromImageTest-40313828 None] Lock "cinder-quobyte-3dcc9bd2-6e23-406a-a6b3-796f1ef1ede2" released by "delete_volume" :: held 0.726s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:08:32 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-254c4397-65ce-4944-9f72-1650c7618479 tempest-CreateVolumesFromImageTest-40313828 None] Created reservations ['e5a69cb3-058c-4893-a4c6-be1b74477750', '831daba9-cc9f-4b44-be11-9077d660abf2', '18970077-4656-430b-ac8f-4855e5676c11', '0922c87e-cee2-4228-9805-680e42b01622'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:08:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-254c4397-65ce-4944-9f72-1650c7618479 tempest-CreateVolumesFromImageTest-40313828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-254c4397-65ce-4944-9f72-1650c7618479 tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-254c4397-65ce-4944-9f72-1650c7618479 tempest-CreateVolumesFromImageTest-40313828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:08:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-254c4397-65ce-4944-9f72-1650c7618479 tempest-CreateVolumesFromImageTest-40313828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:08:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-254c4397-65ce-4944-9f72-1650c7618479 tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-254c4397-65ce-4944-9f72-1650c7618479 tempest-CreateVolumesFromImageTest-40313828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:33 devstack sudo[103110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:08:33 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-01f331f4-140f-4f2a-90b3-abfc9a22a82d tempest-CreateVolumesFromImageTest-40313828 None] Acquiring lock "cinder-097a29d4-195e-4a84-a240-0cabbba2b9d0-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:08:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-01f331f4-140f-4f2a-90b3-abfc9a22a82d tempest-CreateVolumesFromImageTest-40313828 None] Lock "cinder-097a29d4-195e-4a84-a240-0cabbba2b9d0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:08:33 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-254c4397-65ce-4944-9f72-1650c7618479 tempest-CreateVolumesFromImageTest-40313828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.282s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:33 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-254c4397-65ce-4944-9f72-1650c7618479 tempest-CreateVolumesFromImageTest-40313828 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:08:33 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-254c4397-65ce-4944-9f72-1650c7618479 tempest-CreateVolumesFromImageTest-40313828 None] Deleted volume successfully. Sep 21 12:08:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-01f331f4-140f-4f2a-90b3-abfc9a22a82d tempest-CreateVolumesFromImageTest-40313828 None] Acquiring lock "cinder-quobyte-097a29d4-195e-4a84-a240-0cabbba2b9d0" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:08:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-254c4397-65ce-4944-9f72-1650c7618479 tempest-CreateVolumesFromImageTest-40313828 None] Lock "cinder-3dcc9bd2-6e23-406a-a6b3-796f1ef1ede2-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:08:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-01f331f4-140f-4f2a-90b3-abfc9a22a82d tempest-CreateVolumesFromImageTest-40313828 None] Lock "cinder-quobyte-097a29d4-195e-4a84-a240-0cabbba2b9d0" acquired by "delete_volume" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:08:33 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e6277b-3061-4739-97f7-dcd3d961b8f4]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:08:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-01f331f4-140f-4f2a-90b3-abfc9a22a82d tempest-CreateVolumesFromImageTest-40313828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-097a29d4-195e-4a84-a240-0cabbba2b9d0 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:33 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-097a29d4-195e-4a84-a240-0cabbba2b9d0 Sep 21 12:08:33 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:33 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:08:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Flow 'volume_create_manager' (f655765a-39e5-47a4-a168-816e01ad825b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:08:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad35bb13-edf9-4217-8bb9-f765d91c93d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:33 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad35bb13-edf9-4217-8bb9-f765d91c93d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-852524812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddba65eb-3e75-4cc4-a67c-3fc751fac234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ddc0277e25420eb8f8da17d2d1c3e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:08:34Z,use_quota=True,user_id='30fd3a480394455e92c7093655f802ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e143f5a-d27b-40ae-b4f4-d0ed4ac97bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e143f5a-d27b-40ae-b4f4-d0ed4ac97bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d356be8e-fc0e-4422-9822-1e8260eca7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:33 devstack cinder-volume[86366]: DEBUG cinder.image.glance [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Creating Keystone auth plugin from conf {{(pid=86366) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 21 12:08:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-01f331f4-140f-4f2a-90b3-abfc9a22a82d tempest-CreateVolumesFromImageTest-40313828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-097a29d4-195e-4a84-a240-0cabbba2b9d0" returned: 0 in 0.417s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-01f331f4-140f-4f2a-90b3-abfc9a22a82d tempest-CreateVolumesFromImageTest-40313828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-097a29d4-195e-4a84-a240-0cabbba2b9d0 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:33 devstack sudo[103118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-097a29d4-195e-4a84-a240-0cabbba2b9d0 Sep 21 12:08:33 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:34 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-01f331f4-140f-4f2a-90b3-abfc9a22a82d tempest-CreateVolumesFromImageTest-40313828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-097a29d4-195e-4a84-a240-0cabbba2b9d0" returned: 0 in 0.255s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-01f331f4-140f-4f2a-90b3-abfc9a22a82d tempest-CreateVolumesFromImageTest-40313828 None] Lock "cinder-quobyte-097a29d4-195e-4a84-a240-0cabbba2b9d0" released by "delete_volume" :: held 0.724s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d356be8e-fc0e-4422-9822-1e8260eca7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ddba65eb-3e75-4cc4-a67c-3fc751fac234', 'volume_name': 'volume-ddba65eb-3e75-4cc4-a67c-3fc751fac234', 'volume_size': 1, 'image_id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6c23462c1d34d9a9d8fbc8d8872d421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'created_at': datetime.datetime(2026, 9, 21, 9, 44, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 9, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac3d3f3-8078-441f-8b9b-f3a2d83946d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac3d3f3-8078-441f-8b9b-f3a2d83946d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a46fc05-ad2e-471b-94e8-9cea90e7eb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:34 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Volume ddba65eb-3e75-4cc4-a67c-3fc751fac234: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ddba65eb-3e75-4cc4-a67c-3fc751fac234', 'volume_size': 1, 'image_id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6c23462c1d34d9a9d8fbc8d8872d421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'created_at': datetime.datetime(2026, 9, 21, 9, 44, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 9, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Trying to clone ddba65eb-3e75-4cc4-a67c-3fc751fac234 from image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}]). {{(pid=86366) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-01f331f4-140f-4f2a-90b3-abfc9a22a82d tempest-CreateVolumesFromImageTest-40313828 None] Created reservations ['12227c3d-7b2d-4495-b430-77551cb62346', '584f2a0a-f89a-4455-8a02-0bb677208c2e', '84252f41-027d-4ae5-bd4d-6841b7f22318', '8220588f-5395-4cb0-a37d-4f5dae3774c0'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-01f331f4-140f-4f2a-90b3-abfc9a22a82d tempest-CreateVolumesFromImageTest-40313828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-01f331f4-140f-4f2a-90b3-abfc9a22a82d tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-01f331f4-140f-4f2a-90b3-abfc9a22a82d tempest-CreateVolumesFromImageTest-40313828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-01f331f4-140f-4f2a-90b3-abfc9a22a82d tempest-CreateVolumesFromImageTest-40313828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-01f331f4-140f-4f2a-90b3-abfc9a22a82d tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-01f331f4-140f-4f2a-90b3-abfc9a22a82d tempest-CreateVolumesFromImageTest-40313828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:34 devstack sudo[103121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:08:34 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e1312bcb-4a05-4e68-8648-b1b675b28668 tempest-CreateVolumesFromImageTest-40313828 None] Acquiring lock "cinder-80feabf4-224b-4a84-8165-b0f94d027c1b-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_0j16uq06devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 21 12:08:34 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Image download 20.69 MB at 20.69 MB/s Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e1312bcb-4a05-4e68-8648-b1b675b28668 tempest-CreateVolumesFromImageTest-40313828 None] Lock "cinder-80feabf4-224b-4a84-8165-b0f94d027c1b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:08:34 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-01f331f4-140f-4f2a-90b3-abfc9a22a82d tempest-CreateVolumesFromImageTest-40313828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.281s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-01f331f4-140f-4f2a-90b3-abfc9a22a82d tempest-CreateVolumesFromImageTest-40313828 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:08:34 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-01f331f4-140f-4f2a-90b3-abfc9a22a82d tempest-CreateVolumesFromImageTest-40313828 None] Deleted volume successfully. Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9237061-da81-469a-8f9c-8260eb39767a]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_0j16uq06devstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-01f331f4-140f-4f2a-90b3-abfc9a22a82d tempest-CreateVolumesFromImageTest-40313828 None] Lock "cinder-097a29d4-195e-4a84-a240-0cabbba2b9d0-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e1312bcb-4a05-4e68-8648-b1b675b28668 tempest-CreateVolumesFromImageTest-40313828 None] Acquiring lock "cinder-quobyte-80feabf4-224b-4a84-8165-b0f94d027c1b" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e1312bcb-4a05-4e68-8648-b1b675b28668 tempest-CreateVolumesFromImageTest-40313828 None] Lock "cinder-quobyte-80feabf4-224b-4a84-8165-b0f94d027c1b" acquired by "delete_volume" :: waited 0.012s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[343e4938-afde-42f3-8bc7-34db6c579d2a]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e1312bcb-4a05-4e68-8648-b1b675b28668 tempest-CreateVolumesFromImageTest-40313828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-80feabf4-224b-4a84-8165-b0f94d027c1b {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:34 devstack sudo[103125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_0j16uq06devstack@QuobyteHD Sep 21 12:08:34 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:34 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-80feabf4-224b-4a84-8165-b0f94d027c1b Sep 21 12:08:34 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:34 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_0j16uq06devstack@QuobyteHD" returned: 0 in 0.321s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Temporary image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 is fetched for user 30fd3a480394455e92c7093655f802ee. {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab2f3f0-883d-41fa-b1b3-0003d466ffb8]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_0j16uq06devstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:34 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e1312bcb-4a05-4e68-8648-b1b675b28668 tempest-CreateVolumesFromImageTest-40313828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-80feabf4-224b-4a84-8165-b0f94d027c1b" returned: 0 in 0.395s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e1312bcb-4a05-4e68-8648-b1b675b28668 tempest-CreateVolumesFromImageTest-40313828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-80feabf4-224b-4a84-8165-b0f94d027c1b {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:35 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-80feabf4-224b-4a84-8165-b0f94d027c1b Sep 21 12:08:35 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:35 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_0j16uq06devstack@QuobyteHD Sep 21 12:08:35 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:35 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_0j16uq06devstack@QuobyteHD" returned: 0 in 0.322s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-852524812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddba65eb-3e75-4cc4-a67c-3fc751fac234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ddc0277e25420eb8f8da17d2d1c3e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:08:34Z,use_quota=True,user_id='30fd3a480394455e92c7093655f802ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Creating volume ddba65eb-3e75-4cc4-a67c-3fc751fac234 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:08:35 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:08:35 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ddba65eb-3e75-4cc4-a67c-3fc751fac234 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e1312bcb-4a05-4e68-8648-b1b675b28668 tempest-CreateVolumesFromImageTest-40313828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-80feabf4-224b-4a84-8165-b0f94d027c1b" returned: 0 in 0.280s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e1312bcb-4a05-4e68-8648-b1b675b28668 tempest-CreateVolumesFromImageTest-40313828 None] Lock "cinder-quobyte-80feabf4-224b-4a84-8165-b0f94d027c1b" released by "delete_volume" :: held 0.719s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:08:35 devstack sudo[103143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ddba65eb-3e75-4cc4-a67c-3fc751fac234 1073741824 Sep 21 12:08:35 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-e1312bcb-4a05-4e68-8648-b1b675b28668 tempest-CreateVolumesFromImageTest-40313828 None] Created reservations ['40903c51-c333-4da8-b784-aa6355e2ad84', '11d6af33-89d8-4634-8710-8bd7eeb13735', '023f9680-b288-4780-9d51-f900d00564f4', 'f168134f-5071-4445-8dc6-35d4341cb5a0'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e1312bcb-4a05-4e68-8648-b1b675b28668 tempest-CreateVolumesFromImageTest-40313828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e1312bcb-4a05-4e68-8648-b1b675b28668 tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e1312bcb-4a05-4e68-8648-b1b675b28668 tempest-CreateVolumesFromImageTest-40313828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e1312bcb-4a05-4e68-8648-b1b675b28668 tempest-CreateVolumesFromImageTest-40313828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e1312bcb-4a05-4e68-8648-b1b675b28668 tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e1312bcb-4a05-4e68-8648-b1b675b28668 tempest-CreateVolumesFromImageTest-40313828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:35 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:08:35 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-bfe8d771-9433-44b9-91aa-5af8feda1228 tempest-CreateVolumesFromImageTest-40313828 None] Acquiring lock "cinder-43cb2604-1b7d-4f4a-a37c-fe704e12d0c0-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-bfe8d771-9433-44b9-91aa-5af8feda1228 tempest-CreateVolumesFromImageTest-40313828 None] Lock "cinder-43cb2604-1b7d-4f4a-a37c-fe704e12d0c0-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:08:35 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e1312bcb-4a05-4e68-8648-b1b675b28668 tempest-CreateVolumesFromImageTest-40313828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.286s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-e1312bcb-4a05-4e68-8648-b1b675b28668 tempest-CreateVolumesFromImageTest-40313828 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:08:35 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-e1312bcb-4a05-4e68-8648-b1b675b28668 tempest-CreateVolumesFromImageTest-40313828 None] Deleted volume successfully. Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e1312bcb-4a05-4e68-8648-b1b675b28668 tempest-CreateVolumesFromImageTest-40313828 None] Lock "cinder-80feabf4-224b-4a84-8165-b0f94d027c1b-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-bfe8d771-9433-44b9-91aa-5af8feda1228 tempest-CreateVolumesFromImageTest-40313828 None] Acquiring lock "cinder-quobyte-43cb2604-1b7d-4f4a-a37c-fe704e12d0c0" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-bfe8d771-9433-44b9-91aa-5af8feda1228 tempest-CreateVolumesFromImageTest-40313828 None] Lock "cinder-quobyte-43cb2604-1b7d-4f4a-a37c-fe704e12d0c0" acquired by "delete_volume" :: waited 0.015s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb89e083-0d31-49bf-8f93-63a5a7cf5fa4]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bfe8d771-9433-44b9-91aa-5af8feda1228 tempest-CreateVolumesFromImageTest-40313828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-43cb2604-1b7d-4f4a-a37c-fe704e12d0c0 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:35 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ddba65eb-3e75-4cc4-a67c-3fc751fac234 1073741824" returned: 0 in 0.582s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ddba65eb-3e75-4cc4-a67c-3fc751fac234 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:35 devstack sudo[103153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ddba65eb-3e75-4cc4-a67c-3fc751fac234 Sep 21 12:08:35 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:35 devstack sudo[103152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-43cb2604-1b7d-4f4a-a37c-fe704e12d0c0 Sep 21 12:08:35 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:36 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ddba65eb-3e75-4cc4-a67c-3fc751fac234" returned: 0 in 0.267s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:36 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Attempting download of 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 ((None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}])) to volume ddba65eb-3e75-4cc4-a67c-3fc751fac234. {{(pid=86366) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bfe8d771-9433-44b9-91aa-5af8feda1228 tempest-CreateVolumesFromImageTest-40313828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-43cb2604-1b7d-4f4a-a37c-fe704e12d0c0" returned: 0 in 0.384s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bfe8d771-9433-44b9-91aa-5af8feda1228 tempest-CreateVolumesFromImageTest-40313828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-43cb2604-1b7d-4f4a-a37c-fe704e12d0c0 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:36 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-43cb2604-1b7d-4f4a-a37c-fe704e12d0c0 Sep 21 12:08:36 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6d4982-3f1b-4f75-9eb2-aaae27a6f3a9]: (4, 'raw') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_hw97tne9 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:36 devstack sudo[103162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_hw97tne9 Sep 21 12:08:36 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:36 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bfe8d771-9433-44b9-91aa-5af8feda1228 tempest-CreateVolumesFromImageTest-40313828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-43cb2604-1b7d-4f4a-a37c-fe704e12d0c0" returned: 0 in 0.267s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-bfe8d771-9433-44b9-91aa-5af8feda1228 tempest-CreateVolumesFromImageTest-40313828 None] Lock "cinder-quobyte-43cb2604-1b7d-4f4a-a37c-fe704e12d0c0" released by "delete_volume" :: held 0.702s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-bfe8d771-9433-44b9-91aa-5af8feda1228 tempest-CreateVolumesFromImageTest-40313828 None] Created reservations ['c065a355-5160-41b6-b02d-7eb6b15707da', '75539791-2f09-4b73-b87d-cad3ef00a8f0', '663d3522-c826-4d05-9bd0-b580f28ad66b', '662f1277-41da-4153-a1bc-91ea6472f0dc'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:08:36 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_hw97tne9" returned: 0 in 0.360s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_hw97tne9 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-bfe8d771-9433-44b9-91aa-5af8feda1228 tempest-CreateVolumesFromImageTest-40313828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-bfe8d771-9433-44b9-91aa-5af8feda1228 tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-bfe8d771-9433-44b9-91aa-5af8feda1228 tempest-CreateVolumesFromImageTest-40313828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-bfe8d771-9433-44b9-91aa-5af8feda1228 tempest-CreateVolumesFromImageTest-40313828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-bfe8d771-9433-44b9-91aa-5af8feda1228 tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bfe8d771-9433-44b9-91aa-5af8feda1228 tempest-CreateVolumesFromImageTest-40313828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:36 devstack sudo[103168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:08:36 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:36 devstack sudo[103167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_hw97tne9 Sep 21 12:08:36 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3484ee8c-15c2-4ec5-a2c1-0c7f9b25536f tempest-CreateVolumesFromImageTest-40313828 None] Acquiring lock "cinder-ff2acc3b-9f05-44f1-87f3-3a3b6c559081-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3484ee8c-15c2-4ec5-a2c1-0c7f9b25536f tempest-CreateVolumesFromImageTest-40313828 None] Lock "cinder-ff2acc3b-9f05-44f1-87f3-3a3b6c559081-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3484ee8c-15c2-4ec5-a2c1-0c7f9b25536f tempest-CreateVolumesFromImageTest-40313828 None] Acquiring lock "cinder-quobyte-ff2acc3b-9f05-44f1-87f3-3a3b6c559081" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3484ee8c-15c2-4ec5-a2c1-0c7f9b25536f tempest-CreateVolumesFromImageTest-40313828 None] Lock "cinder-quobyte-ff2acc3b-9f05-44f1-87f3-3a3b6c559081" acquired by "delete_volume" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:08:36 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bfe8d771-9433-44b9-91aa-5af8feda1228 tempest-CreateVolumesFromImageTest-40313828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.319s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-bfe8d771-9433-44b9-91aa-5af8feda1228 tempest-CreateVolumesFromImageTest-40313828 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:08:36 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_hw97tne9" returned: 1 in 0.347s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_hw97tne9' failed. Not Retrying. {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 12:08:36 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-bfe8d771-9433-44b9-91aa-5af8feda1228 tempest-CreateVolumesFromImageTest-40313828 None] Deleted volume successfully. Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[178509a0-bdec-4d3e-8d17-ceacc13e3d74]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3f2e79-1f20-4ed4-b5bd-6311372579c8]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_0j16uq06devstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3484ee8c-15c2-4ec5-a2c1-0c7f9b25536f tempest-CreateVolumesFromImageTest-40313828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ff2acc3b-9f05-44f1-87f3-3a3b6c559081 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:36 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-bfe8d771-9433-44b9-91aa-5af8feda1228 tempest-CreateVolumesFromImageTest-40313828 None] Lock "cinder-43cb2604-1b7d-4f4a-a37c-fe704e12d0c0-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:08:37 devstack sudo[103174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_0j16uq06devstack@QuobyteHD Sep 21 12:08:37 devstack sudo[103174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:37 devstack sudo[103175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ff2acc3b-9f05-44f1-87f3-3a3b6c559081 Sep 21 12:08:37 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:37 devstack sudo[103174]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_0j16uq06devstack@QuobyteHD" returned: 0 in 0.325s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:37 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 was qcow2, converting to qcow2 {{(pid=86366) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 21 12:08:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_0j16uq06devstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ddba65eb-3e75-4cc4-a67c-3fc751fac234 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:37 devstack sudo[103183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_0j16uq06devstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ddba65eb-3e75-4cc4-a67c-3fc751fac234 Sep 21 12:08:37 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:37 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3484ee8c-15c2-4ec5-a2c1-0c7f9b25536f tempest-CreateVolumesFromImageTest-40313828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ff2acc3b-9f05-44f1-87f3-3a3b6c559081" returned: 0 in 0.377s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3484ee8c-15c2-4ec5-a2c1-0c7f9b25536f tempest-CreateVolumesFromImageTest-40313828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ff2acc3b-9f05-44f1-87f3-3a3b6c559081 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:37 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ff2acc3b-9f05-44f1-87f3-3a3b6c559081 Sep 21 12:08:37 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:37 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3484ee8c-15c2-4ec5-a2c1-0c7f9b25536f tempest-CreateVolumesFromImageTest-40313828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ff2acc3b-9f05-44f1-87f3-3a3b6c559081" returned: 0 in 0.260s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3484ee8c-15c2-4ec5-a2c1-0c7f9b25536f tempest-CreateVolumesFromImageTest-40313828 None] Lock "cinder-quobyte-ff2acc3b-9f05-44f1-87f3-3a3b6c559081" released by "delete_volume" :: held 0.702s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:08:37 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-3484ee8c-15c2-4ec5-a2c1-0c7f9b25536f tempest-CreateVolumesFromImageTest-40313828 None] Created reservations ['b9489f40-7372-4dbb-af95-3fc70bbf4eea', 'c7280809-377b-4ce1-9f02-de539da8146b', '33302eac-8916-4966-8b80-49df16aae2fe', '5d244acf-38d0-4344-bacf-9b42b134ac11'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:08:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3484ee8c-15c2-4ec5-a2c1-0c7f9b25536f tempest-CreateVolumesFromImageTest-40313828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3484ee8c-15c2-4ec5-a2c1-0c7f9b25536f tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:37 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3484ee8c-15c2-4ec5-a2c1-0c7f9b25536f tempest-CreateVolumesFromImageTest-40313828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:08:37 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3484ee8c-15c2-4ec5-a2c1-0c7f9b25536f tempest-CreateVolumesFromImageTest-40313828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:08:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3484ee8c-15c2-4ec5-a2c1-0c7f9b25536f tempest-CreateVolumesFromImageTest-40313828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3484ee8c-15c2-4ec5-a2c1-0c7f9b25536f tempest-CreateVolumesFromImageTest-40313828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:37 devstack sudo[103196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:08:37 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:38 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3484ee8c-15c2-4ec5-a2c1-0c7f9b25536f tempest-CreateVolumesFromImageTest-40313828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.299s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:38 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-3484ee8c-15c2-4ec5-a2c1-0c7f9b25536f tempest-CreateVolumesFromImageTest-40313828 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:08:38 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-3484ee8c-15c2-4ec5-a2c1-0c7f9b25536f tempest-CreateVolumesFromImageTest-40313828 None] Deleted volume successfully. Sep 21 12:08:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3484ee8c-15c2-4ec5-a2c1-0c7f9b25536f tempest-CreateVolumesFromImageTest-40313828 None] Lock "cinder-ff2acc3b-9f05-44f1-87f3-3a3b6c559081-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:08:39 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_0j16uq06devstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ddba65eb-3e75-4cc4-a67c-3fc751fac234" returned: 0 in 1.952s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:39 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7d7c1e61-a2f2-4143-bb38-e9f80cf68c87_0j16uq06devstack@QuobyteHD, size 112.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ddba65eb-3e75-4cc4-a67c-3fc751fac234 {{(pid=86366) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 12:08:39 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Converted 112.00 MB image at 57.36 MB/s Sep 21 12:08:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ddba65eb-3e75-4cc4-a67c-3fc751fac234 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:39 devstack sudo[103199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ddba65eb-3e75-4cc4-a67c-3fc751fac234 1G Sep 21 12:08:39 devstack sudo[103199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:39 devstack sudo[103199]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ddba65eb-3e75-4cc4-a67c-3fc751fac234 1G" returned: 0 in 0.340s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:39 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Downloaded image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 ((None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}])) to volume ddba65eb-3e75-4cc4-a67c-3fc751fac234 successfully. {{(pid=86366) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 21 12:08:39 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Temporary image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 for user 30fd3a480394455e92c7093655f802ee is deleted. {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 21 12:08:39 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Marking volume ddba65eb-3e75-4cc4-a67c-3fc751fac234 as bootable. {{(pid=86366) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 21 12:08:39 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Copying metadata from image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 to ddba65eb-3e75-4cc4-a67c-3fc751fac234. {{(pid=86366) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 21 12:08:39 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Creating volume glance metadata for volume ddba65eb-3e75-4cc4-a67c-3fc751fac234 backed by image 7d7c1e61-a2f2-4143-bb38-e9f80cf68c87 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86366) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 21 12:08:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a46fc05-ad2e-471b-94e8-9cea90e7eb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddba65eb-3e75-4cc4-a67c-3fc751fac234', 'volume_size': 1, 'image_id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a6c23462c1d34d9a9d8fbc8d8872d421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7d7c1e61-a2f2-4143-bb38-e9f80cf68c87', 'created_at': datetime.datetime(2026, 9, 21, 9, 44, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 9, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7d7c1e61-a2f2-4143-bb38-e9f80cf68c87/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1cbfb8-15d6-4e17-8baf-cd9bef153251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:39 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Volume volume-ddba65eb-3e75-4cc4-a67c-3fc751fac234 (ddba65eb-3e75-4cc4-a67c-3fc751fac234): created successfully Sep 21 12:08:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1cbfb8-15d6-4e17-8baf-cd9bef153251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Flow 'volume_create_manager' (f655765a-39e5-47a4-a168-816e01ad825b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:08:39 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-0b2a7765-d58b-44c4-b67f-f93cbdb5a981 tempest-TestShelveInstance-363078156 None] Created volume successfully. Sep 21 12:08:40 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:08:40 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Flow 'volume_create_manager' (541eb13f-e33b-4944-aa5c-3fe4c6a7d47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:08:40 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e96f65-2920-4e14-a4e4-7a1b37611992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e96f65-2920-4e14-a4e4-7a1b37611992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1291062613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01481b88-5efb-45d4-b187-fcfdd309ca75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b880e37e07bc4b5db328bc990e466f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:08:41Z,use_quota=True,user_id='8bc83e46a9bc456280b53972c595dc53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c923e15-05a9-4cf8-805f-38d5083d062d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c923e15-05a9-4cf8-805f-38d5083d062d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65598826-5e49-45e8-9074-532c832dcdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65598826-5e49-45e8-9074-532c832dcdeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01481b88-5efb-45d4-b187-fcfdd309ca75', 'volume_name': 'volume-01481b88-5efb-45d4-b187-fcfdd309ca75', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bea6662-620d-4991-aa49-31614f490261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bea6662-620d-4991-aa49-31614f490261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aafb966-64b4-4dd8-8ebe-06c87663419f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:41 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Volume 01481b88-5efb-45d4-b187-fcfdd309ca75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01481b88-5efb-45d4-b187-fcfdd309ca75', 'volume_size': 1} Sep 21 12:08:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:41 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1291062613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01481b88-5efb-45d4-b187-fcfdd309ca75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b880e37e07bc4b5db328bc990e466f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:08:41Z,use_quota=True,user_id='8bc83e46a9bc456280b53972c595dc53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:08:41 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Creating volume 01481b88-5efb-45d4-b187-fcfdd309ca75 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:08:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:41 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:08:41 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:08:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:41 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:08:41 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:08:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-01481b88-5efb-45d4-b187-fcfdd309ca75 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:41 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-01481b88-5efb-45d4-b187-fcfdd309ca75 1073741824 Sep 21 12:08:41 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:41 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-01481b88-5efb-45d4-b187-fcfdd309ca75 1073741824" returned: 0 in 0.475s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-01481b88-5efb-45d4-b187-fcfdd309ca75 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:41 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-01481b88-5efb-45d4-b187-fcfdd309ca75 Sep 21 12:08:41 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:41 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-01481b88-5efb-45d4-b187-fcfdd309ca75" returned: 0 in 0.243s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:41 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:08:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aafb966-64b4-4dd8-8ebe-06c87663419f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01481b88-5efb-45d4-b187-fcfdd309ca75', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (646bbf64-d958-4816-a629-a4656c2b9fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:41 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Volume volume-01481b88-5efb-45d4-b187-fcfdd309ca75 (01481b88-5efb-45d4-b187-fcfdd309ca75): created successfully Sep 21 12:08:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (646bbf64-d958-4816-a629-a4656c2b9fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Flow 'volume_create_manager' (541eb13f-e33b-4944-aa5c-3fe4c6a7d47e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:08:41 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-63ad3b4d-cd4a-4c83-873e-a5988b88d601 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Created volume successfully. Sep 21 12:08:42 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:08:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Flow 'volume_create_manager' (7a4af118-05f0-42e3-951a-dfc69418c79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:08:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb4c15c2-4f62-4b77-8f40-c905c57cf72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb4c15c2-4f62-4b77-8f40-c905c57cf72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1091234010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62fd9516-e664-4a86-8d98-5932c1ae0443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b880e37e07bc4b5db328bc990e466f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:08:42Z,use_quota=True,user_id='8bc83e46a9bc456280b53972c595dc53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (557ecc77-2c7c-4294-9313-e9dc229e07b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (557ecc77-2c7c-4294-9313-e9dc229e07b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae53d896-4351-475a-9bba-03a79646c55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae53d896-4351-475a-9bba-03a79646c55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62fd9516-e664-4a86-8d98-5932c1ae0443', 'volume_name': 'volume-62fd9516-e664-4a86-8d98-5932c1ae0443', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ada3d6-17b1-4482-bce4-4e041a49944a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08ada3d6-17b1-4482-bce4-4e041a49944a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef7014b4-4477-4fc1-bef6-3d2a1b87c109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:42 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Volume 62fd9516-e664-4a86-8d98-5932c1ae0443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62fd9516-e664-4a86-8d98-5932c1ae0443', 'volume_size': 1} Sep 21 12:08:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:42 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1091234010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62fd9516-e664-4a86-8d98-5932c1ae0443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b880e37e07bc4b5db328bc990e466f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:08:42Z,use_quota=True,user_id='8bc83e46a9bc456280b53972c595dc53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:08:42 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Creating volume 62fd9516-e664-4a86-8d98-5932c1ae0443 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:08:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:42 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:08:42 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:08:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:42 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:08:42 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:08:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-62fd9516-e664-4a86-8d98-5932c1ae0443 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:42 devstack sudo[103216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-62fd9516-e664-4a86-8d98-5932c1ae0443 1073741824 Sep 21 12:08:42 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Flow 'volume_create_manager' (32500e25-044b-4588-8631-585ad2a883e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0baef2f1-0bff-4af6-99c7-a20eb50a97a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0baef2f1-0bff-4af6-99c7-a20eb50a97a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1498277588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aba05781-38e9-4ae4-a16e-c2eb51ed062c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b880e37e07bc4b5db328bc990e466f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:08:43Z,use_quota=True,user_id='8bc83e46a9bc456280b53972c595dc53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f9502a-4aa9-46ff-b027-7922b01fb5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f9502a-4aa9-46ff-b027-7922b01fb5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802da6fb-ca1a-40b4-8d1d-cdffc7eb267c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (802da6fb-ca1a-40b4-8d1d-cdffc7eb267c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aba05781-38e9-4ae4-a16e-c2eb51ed062c', 'volume_name': 'volume-aba05781-38e9-4ae4-a16e-c2eb51ed062c', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628db790-3702-4a8a-93c3-1611fb15c5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (628db790-3702-4a8a-93c3-1611fb15c5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2559b7e9-d766-482b-9772-7532284b72e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:43 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Volume aba05781-38e9-4ae4-a16e-c2eb51ed062c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aba05781-38e9-4ae4-a16e-c2eb51ed062c', 'volume_size': 1} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-063feb9d-212b-4c81-8a4c-50d74096be92 req-156809f6-0b74-4303-a383-66c66a700777 tempest-TestShelveInstance-363078156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:43 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-62fd9516-e664-4a86-8d98-5932c1ae0443 1073741824" returned: 0 in 0.608s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-62fd9516-e664-4a86-8d98-5932c1ae0443 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:43 devstack sudo[103230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-62fd9516-e664-4a86-8d98-5932c1ae0443 Sep 21 12:08:43 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Flow 'volume_create_manager' (95b77059-080d-4861-8894-30bbbe5ca3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6115f231-8a5f-4e82-8613-277ffacd7131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6115f231-8a5f-4e82-8613-277ffacd7131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1380721120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f06d11bb-19a1-4b44-9d0f-0b58b5407348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b880e37e07bc4b5db328bc990e466f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:08:43Z,use_quota=True,user_id='8bc83e46a9bc456280b53972c595dc53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f9c41ad-4e6e-47a4-a3ec-fc95e31aa0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f9c41ad-4e6e-47a4-a3ec-fc95e31aa0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c5eddb-de80-4b50-a8b7-9ac428184044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c5eddb-de80-4b50-a8b7-9ac428184044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f06d11bb-19a1-4b44-9d0f-0b58b5407348', 'volume_name': 'volume-f06d11bb-19a1-4b44-9d0f-0b58b5407348', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb76866-3d6b-49c9-8917-2c82d3cca6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb76866-3d6b-49c9-8917-2c82d3cca6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a45b671-5724-4431-97bb-324ab51b3ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:43 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Volume f06d11bb-19a1-4b44-9d0f-0b58b5407348: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f06d11bb-19a1-4b44-9d0f-0b58b5407348', 'volume_size': 1} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:43 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-62fd9516-e664-4a86-8d98-5932c1ae0443" returned: 0 in 0.403s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.593s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1498277588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aba05781-38e9-4ae4-a16e-c2eb51ed062c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b880e37e07bc4b5db328bc990e466f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:08:43Z,use_quota=True,user_id='8bc83e46a9bc456280b53972c595dc53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Creating volume aba05781-38e9-4ae4-a16e-c2eb51ed062c {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:08:43 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-aba05781-38e9-4ae4-a16e-c2eb51ed062c 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:43 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-aba05781-38e9-4ae4-a16e-c2eb51ed062c 1073741824 Sep 21 12:08:43 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef7014b4-4477-4fc1-bef6-3d2a1b87c109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62fd9516-e664-4a86-8d98-5932c1ae0443', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0526b761-1ad1-4c0c-a3d6-5d6403b7ec00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:43 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Volume volume-62fd9516-e664-4a86-8d98-5932c1ae0443 (62fd9516-e664-4a86-8d98-5932c1ae0443): created successfully Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0526b761-1ad1-4c0c-a3d6-5d6403b7ec00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Flow 'volume_create_manager' (7a4af118-05f0-42e3-951a-dfc69418c79c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:08:43 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-2fdd2df1-eefe-4365-8179-8b6cd1a0b352 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Created volume successfully. Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Flow 'volume_create_manager' (6b26af59-49a0-4426-a763-3b621d1fdb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a21cc0da-74e8-44df-9787-cc70a3a13ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a21cc0da-74e8-44df-9787-cc70a3a13ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-459424473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54616adf-9cde-4c00-8f4d-7dcfc54eedaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b880e37e07bc4b5db328bc990e466f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:08:44Z,use_quota=True,user_id='8bc83e46a9bc456280b53972c595dc53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6485a1f-4721-4eca-85c3-598d74a78e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6485a1f-4721-4eca-85c3-598d74a78e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (482721c2-5eca-46e6-9bbb-b6164357d55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (482721c2-5eca-46e6-9bbb-b6164357d55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54616adf-9cde-4c00-8f4d-7dcfc54eedaa', 'volume_name': 'volume-54616adf-9cde-4c00-8f4d-7dcfc54eedaa', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb6ac79e-9132-4f75-b364-a049d657cdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb6ac79e-9132-4f75-b364-a049d657cdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4767c843-762d-43a7-9716-91824fa7a4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:44 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Volume 54616adf-9cde-4c00-8f4d-7dcfc54eedaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54616adf-9cde-4c00-8f4d-7dcfc54eedaa', 'volume_size': 1} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:44 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-aba05781-38e9-4ae4-a16e-c2eb51ed062c 1073741824" returned: 0 in 0.562s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-aba05781-38e9-4ae4-a16e-c2eb51ed062c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:44 devstack sudo[103239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-aba05781-38e9-4ae4-a16e-c2eb51ed062c Sep 21 12:08:44 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Flow 'volume_create_manager' (0f67b8ee-02e0-406e-9f4c-5526fe33c3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7270dbef-2d72-441d-900c-673d79e455a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7270dbef-2d72-441d-900c-673d79e455a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-249312904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c49d40f-6eaa-4273-8a2d-a33fa97fe780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b880e37e07bc4b5db328bc990e466f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:08:45Z,use_quota=True,user_id='8bc83e46a9bc456280b53972c595dc53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a702a2-fa5a-4bb7-8e7a-08e35a68b167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a702a2-fa5a-4bb7-8e7a-08e35a68b167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e7eafcd-314c-4462-9729-b8a65b2ec3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e7eafcd-314c-4462-9729-b8a65b2ec3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c49d40f-6eaa-4273-8a2d-a33fa97fe780', 'volume_name': 'volume-9c49d40f-6eaa-4273-8a2d-a33fa97fe780', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2984c76f-8c12-4c5f-8dfe-6b6c76ac9a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2984c76f-8c12-4c5f-8dfe-6b6c76ac9a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3269518e-9103-4bfb-b337-411041aa4798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:44 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Volume 9c49d40f-6eaa-4273-8a2d-a33fa97fe780: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c49d40f-6eaa-4273-8a2d-a33fa97fe780', 'volume_size': 1} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:44 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-aba05781-38e9-4ae4-a16e-c2eb51ed062c" returned: 0 in 0.298s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-063feb9d-212b-4c81-8a4c-50d74096be92 req-156809f6-0b74-4303-a383-66c66a700777 tempest-TestShelveInstance-363078156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.526s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-063feb9d-212b-4c81-8a4c-50d74096be92 req-156809f6-0b74-4303-a383-66c66a700777 tempest-TestShelveInstance-363078156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.025s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1380721120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f06d11bb-19a1-4b44-9d0f-0b58b5407348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b880e37e07bc4b5db328bc990e466f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:08:43Z,use_quota=True,user_id='8bc83e46a9bc456280b53972c595dc53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Creating volume f06d11bb-19a1-4b44-9d0f-0b58b5407348 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:08:44 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f06d11bb-19a1-4b44-9d0f-0b58b5407348 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2559b7e9-d766-482b-9772-7532284b72e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aba05781-38e9-4ae4-a16e-c2eb51ed062c', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:44 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f06d11bb-19a1-4b44-9d0f-0b58b5407348 1073741824 Sep 21 12:08:44 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0389fa83-16cd-4e68-ad73-e1d9bbe8505b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:44 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Volume volume-aba05781-38e9-4ae4-a16e-c2eb51ed062c (aba05781-38e9-4ae4-a16e-c2eb51ed062c): created successfully Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0389fa83-16cd-4e68-ad73-e1d9bbe8505b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Flow 'volume_create_manager' (32500e25-044b-4588-8631-585ad2a883e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:08:44 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-168b3443-68ce-4c01-8eaf-434aa946478c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Created volume successfully. Sep 21 12:08:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-063feb9d-212b-4c81-8a4c-50d74096be92 req-156809f6-0b74-4303-a383-66c66a700777 tempest-TestShelveInstance-363078156 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d', 'name': 'volume-ddba65eb-3e75-4cc4-a67c-3fc751fac234', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec32153e-d3c0-45b8-aa0d-60fe9c185c0f', 'enforce_multipath': True} {{(pid=86366) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 12:08:44 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-063feb9d-212b-4c81-8a4c-50d74096be92 req-156809f6-0b74-4303-a383-66c66a700777 tempest-TestShelveInstance-363078156 None] attachment_update completed successfully. Sep 21 12:08:45 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f06d11bb-19a1-4b44-9d0f-0b58b5407348 1073741824" returned: 0 in 0.559s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f06d11bb-19a1-4b44-9d0f-0b58b5407348 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:45 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f06d11bb-19a1-4b44-9d0f-0b58b5407348 Sep 21 12:08:45 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:45 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f06d11bb-19a1-4b44-9d0f-0b58b5407348" returned: 0 in 0.281s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:08:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.377s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-459424473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54616adf-9cde-4c00-8f4d-7dcfc54eedaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b880e37e07bc4b5db328bc990e466f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:08:44Z,use_quota=True,user_id='8bc83e46a9bc456280b53972c595dc53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:08:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Creating volume 54616adf-9cde-4c00-8f4d-7dcfc54eedaa {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:08:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:08:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:08:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:08:45 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:08:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-54616adf-9cde-4c00-8f4d-7dcfc54eedaa 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:45 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a45b671-5724-4431-97bb-324ab51b3ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f06d11bb-19a1-4b44-9d0f-0b58b5407348', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:45 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-54616adf-9cde-4c00-8f4d-7dcfc54eedaa 1073741824 Sep 21 12:08:45 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:45 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9848de-7628-4551-9a35-ec6bcb3f2ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:45 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Volume volume-f06d11bb-19a1-4b44-9d0f-0b58b5407348 (f06d11bb-19a1-4b44-9d0f-0b58b5407348): created successfully Sep 21 12:08:45 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9848de-7628-4551-9a35-ec6bcb3f2ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:45 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Flow 'volume_create_manager' (95b77059-080d-4861-8894-30bbbe5ca3d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:08:45 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-fdcde7c8-ffb7-42be-a0c4-2437cc9ebd38 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Created volume successfully. Sep 21 12:08:46 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-54616adf-9cde-4c00-8f4d-7dcfc54eedaa 1073741824" returned: 0 in 0.500s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-54616adf-9cde-4c00-8f4d-7dcfc54eedaa {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:46 devstack sudo[103258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-54616adf-9cde-4c00-8f4d-7dcfc54eedaa Sep 21 12:08:46 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:46 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-54616adf-9cde-4c00-8f4d-7dcfc54eedaa" returned: 0 in 0.269s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:08:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.756s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-249312904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c49d40f-6eaa-4273-8a2d-a33fa97fe780,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b880e37e07bc4b5db328bc990e466f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:08:45Z,use_quota=True,user_id='8bc83e46a9bc456280b53972c595dc53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:08:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Creating volume 9c49d40f-6eaa-4273-8a2d-a33fa97fe780 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:08:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:08:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:08:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:08:46 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:08:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9c49d40f-6eaa-4273-8a2d-a33fa97fe780 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4767c843-762d-43a7-9716-91824fa7a4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54616adf-9cde-4c00-8f4d-7dcfc54eedaa', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:46 devstack sudo[103261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9c49d40f-6eaa-4273-8a2d-a33fa97fe780 1073741824 Sep 21 12:08:46 devstack sudo[103261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b1465a-50b8-4823-ac82-af88970ba5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:46 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Volume volume-54616adf-9cde-4c00-8f4d-7dcfc54eedaa (54616adf-9cde-4c00-8f4d-7dcfc54eedaa): created successfully Sep 21 12:08:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b1465a-50b8-4823-ac82-af88970ba5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:46 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Flow 'volume_create_manager' (6b26af59-49a0-4426-a763-3b621d1fdb65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:08:46 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-c6f99455-3f75-4892-9aec-eb8e84274ed1 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Created volume successfully. Sep 21 12:08:47 devstack sudo[103261]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9c49d40f-6eaa-4273-8a2d-a33fa97fe780 1073741824" returned: 0 in 0.723s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9c49d40f-6eaa-4273-8a2d-a33fa97fe780 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:47 devstack sudo[103623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9c49d40f-6eaa-4273-8a2d-a33fa97fe780 Sep 21 12:08:47 devstack sudo[103623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:47 devstack sudo[103623]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9c49d40f-6eaa-4273-8a2d-a33fa97fe780" returned: 0 in 0.440s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:47 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:08:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:47 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3269518e-9103-4bfb-b337-411041aa4798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c49d40f-6eaa-4273-8a2d-a33fa97fe780', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:47 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84dcfd4c-1756-4274-ab82-07752b2a49ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:08:47 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Volume volume-9c49d40f-6eaa-4273-8a2d-a33fa97fe780 (9c49d40f-6eaa-4273-8a2d-a33fa97fe780): created successfully Sep 21 12:08:47 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84dcfd4c-1756-4274-ab82-07752b2a49ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:08:47 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Flow 'volume_create_manager' (0f67b8ee-02e0-406e-9f4c-5526fe33c3be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:08:47 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-448bba83-f07a-41dc-b033-34b7cbaa311e tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Created volume successfully. Sep 21 12:08:48 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fb5820c4-ca72-4d34-b4ea-84ecf3fe4618 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "cinder-9c49d40f-6eaa-4273-8a2d-a33fa97fe780-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:08:48 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fb5820c4-ca72-4d34-b4ea-84ecf3fe4618 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "cinder-9c49d40f-6eaa-4273-8a2d-a33fa97fe780-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:08:48 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fb5820c4-ca72-4d34-b4ea-84ecf3fe4618 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "cinder-quobyte-9c49d40f-6eaa-4273-8a2d-a33fa97fe780" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:08:48 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fb5820c4-ca72-4d34-b4ea-84ecf3fe4618 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "cinder-quobyte-9c49d40f-6eaa-4273-8a2d-a33fa97fe780" acquired by "delete_volume" :: waited 0.019s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:08:48 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaff634-b277-40c7-a361-24782e4737a4]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:08:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fb5820c4-ca72-4d34-b4ea-84ecf3fe4618 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9c49d40f-6eaa-4273-8a2d-a33fa97fe780 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:48 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9c49d40f-6eaa-4273-8a2d-a33fa97fe780 Sep 21 12:08:48 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:48 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fb5820c4-ca72-4d34-b4ea-84ecf3fe4618 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9c49d40f-6eaa-4273-8a2d-a33fa97fe780" returned: 0 in 0.379s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fb5820c4-ca72-4d34-b4ea-84ecf3fe4618 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9c49d40f-6eaa-4273-8a2d-a33fa97fe780 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:48 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9c49d40f-6eaa-4273-8a2d-a33fa97fe780 Sep 21 12:08:48 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:49 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fb5820c4-ca72-4d34-b4ea-84ecf3fe4618 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9c49d40f-6eaa-4273-8a2d-a33fa97fe780" returned: 0 in 0.334s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fb5820c4-ca72-4d34-b4ea-84ecf3fe4618 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "cinder-quobyte-9c49d40f-6eaa-4273-8a2d-a33fa97fe780" released by "delete_volume" :: held 0.774s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:08:49 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-fb5820c4-ca72-4d34-b4ea-84ecf3fe4618 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Created reservations ['1d2ffadc-a5d4-4a33-897e-74b54fca897b', '8e76d81a-1e74-4f3f-a667-4fa0bf7feb95', '139d37b3-fa77-47a1-958e-1b64035ee875', 'b4543e80-cbb9-4f10-9232-5134fcfb75f5'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:08:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fb5820c4-ca72-4d34-b4ea-84ecf3fe4618 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fb5820c4-ca72-4d34-b4ea-84ecf3fe4618 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:49 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fb5820c4-ca72-4d34-b4ea-84ecf3fe4618 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:08:49 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fb5820c4-ca72-4d34-b4ea-84ecf3fe4618 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:08:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fb5820c4-ca72-4d34-b4ea-84ecf3fe4618 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fb5820c4-ca72-4d34-b4ea-84ecf3fe4618 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:49 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:08:49 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0ec05dba-fbc0-4bd0-bb73-1001de77eaae tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "cinder-54616adf-9cde-4c00-8f4d-7dcfc54eedaa-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:08:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0ec05dba-fbc0-4bd0-bb73-1001de77eaae tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "cinder-54616adf-9cde-4c00-8f4d-7dcfc54eedaa-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:08:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0ec05dba-fbc0-4bd0-bb73-1001de77eaae tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "cinder-quobyte-54616adf-9cde-4c00-8f4d-7dcfc54eedaa" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:08:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0ec05dba-fbc0-4bd0-bb73-1001de77eaae tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "cinder-quobyte-54616adf-9cde-4c00-8f4d-7dcfc54eedaa" acquired by "delete_volume" :: waited 0.035s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:08:49 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b739a5-fa24-425d-b429-059dc0433e0b]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:08:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0ec05dba-fbc0-4bd0-bb73-1001de77eaae tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-54616adf-9cde-4c00-8f4d-7dcfc54eedaa {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:49 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fb5820c4-ca72-4d34-b4ea-84ecf3fe4618 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.351s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:49 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-fb5820c4-ca72-4d34-b4ea-84ecf3fe4618 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:08:49 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-fb5820c4-ca72-4d34-b4ea-84ecf3fe4618 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Deleted volume successfully. Sep 21 12:08:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fb5820c4-ca72-4d34-b4ea-84ecf3fe4618 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "cinder-9c49d40f-6eaa-4273-8a2d-a33fa97fe780-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:08:49 devstack sudo[103758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-54616adf-9cde-4c00-8f4d-7dcfc54eedaa Sep 21 12:08:49 devstack sudo[103758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:49 devstack sudo[103758]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0ec05dba-fbc0-4bd0-bb73-1001de77eaae tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-54616adf-9cde-4c00-8f4d-7dcfc54eedaa" returned: 0 in 0.437s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0ec05dba-fbc0-4bd0-bb73-1001de77eaae tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-54616adf-9cde-4c00-8f4d-7dcfc54eedaa {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:49 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-54616adf-9cde-4c00-8f4d-7dcfc54eedaa Sep 21 12:08:49 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:50 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0ec05dba-fbc0-4bd0-bb73-1001de77eaae tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-54616adf-9cde-4c00-8f4d-7dcfc54eedaa" returned: 0 in 0.294s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:50 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0ec05dba-fbc0-4bd0-bb73-1001de77eaae tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "cinder-quobyte-54616adf-9cde-4c00-8f4d-7dcfc54eedaa" released by "delete_volume" :: held 0.793s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:08:50 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-0ec05dba-fbc0-4bd0-bb73-1001de77eaae tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Created reservations ['806769a1-2120-48d6-9871-1c6d0c1aa7dc', 'b734e22e-b600-4446-a65d-b04197afb173', '7c7835d6-3847-449e-b409-a5548ef3cdfa', '09bad658-0cb7-4474-b1c0-531c39050974'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:08:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0ec05dba-fbc0-4bd0-bb73-1001de77eaae tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0ec05dba-fbc0-4bd0-bb73-1001de77eaae tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:50 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0ec05dba-fbc0-4bd0-bb73-1001de77eaae tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:08:50 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0ec05dba-fbc0-4bd0-bb73-1001de77eaae tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:08:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0ec05dba-fbc0-4bd0-bb73-1001de77eaae tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0ec05dba-fbc0-4bd0-bb73-1001de77eaae tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:50 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:08:50 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:50 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c9b1f94d-643d-4fc9-8e9a-42ec83af064c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "cinder-f06d11bb-19a1-4b44-9d0f-0b58b5407348-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:08:50 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c9b1f94d-643d-4fc9-8e9a-42ec83af064c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "cinder-f06d11bb-19a1-4b44-9d0f-0b58b5407348-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:08:50 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c9b1f94d-643d-4fc9-8e9a-42ec83af064c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "cinder-quobyte-f06d11bb-19a1-4b44-9d0f-0b58b5407348" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:08:50 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c9b1f94d-643d-4fc9-8e9a-42ec83af064c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "cinder-quobyte-f06d11bb-19a1-4b44-9d0f-0b58b5407348" acquired by "delete_volume" :: waited 0.026s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:08:50 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0ec05dba-fbc0-4bd0-bb73-1001de77eaae tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.389s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:50 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-0ec05dba-fbc0-4bd0-bb73-1001de77eaae tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:08:50 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-0ec05dba-fbc0-4bd0-bb73-1001de77eaae tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Deleted volume successfully. Sep 21 12:08:50 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[2593cad7-e0ee-4abe-8d99-3f4e59f8c263]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:08:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c9b1f94d-643d-4fc9-8e9a-42ec83af064c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f06d11bb-19a1-4b44-9d0f-0b58b5407348 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:50 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-0ec05dba-fbc0-4bd0-bb73-1001de77eaae tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "cinder-54616adf-9cde-4c00-8f4d-7dcfc54eedaa-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:08:50 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f06d11bb-19a1-4b44-9d0f-0b58b5407348 Sep 21 12:08:50 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:51 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c9b1f94d-643d-4fc9-8e9a-42ec83af064c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f06d11bb-19a1-4b44-9d0f-0b58b5407348" returned: 0 in 0.439s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c9b1f94d-643d-4fc9-8e9a-42ec83af064c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f06d11bb-19a1-4b44-9d0f-0b58b5407348 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:51 devstack sudo[103775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f06d11bb-19a1-4b44-9d0f-0b58b5407348 Sep 21 12:08:51 devstack sudo[103775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:51 devstack sudo[103775]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c9b1f94d-643d-4fc9-8e9a-42ec83af064c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f06d11bb-19a1-4b44-9d0f-0b58b5407348" returned: 0 in 0.302s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:51 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c9b1f94d-643d-4fc9-8e9a-42ec83af064c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "cinder-quobyte-f06d11bb-19a1-4b44-9d0f-0b58b5407348" released by "delete_volume" :: held 0.816s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:08:51 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-c9b1f94d-643d-4fc9-8e9a-42ec83af064c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Created reservations ['7fddf5c6-b458-4c8f-a82d-7930105da543', '430e76cd-f5c6-4d1b-b25a-f81e4a72b7ad', '9091ae4f-be83-4ea9-b073-bed0784ceaf3', '06918165-c807-4479-8c2b-730b0be4c6c1'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:08:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c9b1f94d-643d-4fc9-8e9a-42ec83af064c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c9b1f94d-643d-4fc9-8e9a-42ec83af064c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c9b1f94d-643d-4fc9-8e9a-42ec83af064c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:08:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c9b1f94d-643d-4fc9-8e9a-42ec83af064c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:08:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c9b1f94d-643d-4fc9-8e9a-42ec83af064c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c9b1f94d-643d-4fc9-8e9a-42ec83af064c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:51 devstack sudo[103778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:08:51 devstack sudo[103778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:52 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-849f26bb-7814-4389-9a67-88957e092d87 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "cinder-aba05781-38e9-4ae4-a16e-c2eb51ed062c-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:08:52 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-849f26bb-7814-4389-9a67-88957e092d87 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "cinder-aba05781-38e9-4ae4-a16e-c2eb51ed062c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:08:52 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-849f26bb-7814-4389-9a67-88957e092d87 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "cinder-quobyte-aba05781-38e9-4ae4-a16e-c2eb51ed062c" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:08:52 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-849f26bb-7814-4389-9a67-88957e092d87 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "cinder-quobyte-aba05781-38e9-4ae4-a16e-c2eb51ed062c" acquired by "delete_volume" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:08:52 devstack sudo[103778]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:52 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb31e76-c36a-476b-8dec-03e5c6af4973]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:08:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c9b1f94d-643d-4fc9-8e9a-42ec83af064c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.405s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:52 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-c9b1f94d-643d-4fc9-8e9a-42ec83af064c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:08:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-849f26bb-7814-4389-9a67-88957e092d87 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-aba05781-38e9-4ae4-a16e-c2eb51ed062c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:52 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-c9b1f94d-643d-4fc9-8e9a-42ec83af064c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Deleted volume successfully. Sep 21 12:08:52 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-c9b1f94d-643d-4fc9-8e9a-42ec83af064c tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "cinder-f06d11bb-19a1-4b44-9d0f-0b58b5407348-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:08:52 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-aba05781-38e9-4ae4-a16e-c2eb51ed062c Sep 21 12:08:52 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:52 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-849f26bb-7814-4389-9a67-88957e092d87 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-aba05781-38e9-4ae4-a16e-c2eb51ed062c" returned: 0 in 0.419s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-849f26bb-7814-4389-9a67-88957e092d87 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-aba05781-38e9-4ae4-a16e-c2eb51ed062c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:52 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-aba05781-38e9-4ae4-a16e-c2eb51ed062c Sep 21 12:08:52 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:52 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-849f26bb-7814-4389-9a67-88957e092d87 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-aba05781-38e9-4ae4-a16e-c2eb51ed062c" returned: 0 in 0.363s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:52 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-849f26bb-7814-4389-9a67-88957e092d87 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "cinder-quobyte-aba05781-38e9-4ae4-a16e-c2eb51ed062c" released by "delete_volume" :: held 0.852s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:08:53 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-849f26bb-7814-4389-9a67-88957e092d87 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Created reservations ['98ef554f-17d5-4d12-84d6-93340718734f', '56eb9b45-a57a-4802-bedd-2dbd638a3994', '1cb8f789-e8b4-46c7-9a03-86cacac86549', '4712395e-cfb5-4ad2-9955-93ef155c29b1'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:08:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-849f26bb-7814-4389-9a67-88957e092d87 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-849f26bb-7814-4389-9a67-88957e092d87 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:53 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-849f26bb-7814-4389-9a67-88957e092d87 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:08:53 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-849f26bb-7814-4389-9a67-88957e092d87 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:08:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-849f26bb-7814-4389-9a67-88957e092d87 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-849f26bb-7814-4389-9a67-88957e092d87 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:53 devstack sudo[103789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:08:53 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-ed708d70-0117-40da-b36c-9429dfe6e765 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "cinder-62fd9516-e664-4a86-8d98-5932c1ae0443-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:08:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-ed708d70-0117-40da-b36c-9429dfe6e765 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "cinder-62fd9516-e664-4a86-8d98-5932c1ae0443-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:08:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-ed708d70-0117-40da-b36c-9429dfe6e765 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "cinder-quobyte-62fd9516-e664-4a86-8d98-5932c1ae0443" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:08:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-ed708d70-0117-40da-b36c-9429dfe6e765 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "cinder-quobyte-62fd9516-e664-4a86-8d98-5932c1ae0443" acquired by "delete_volume" :: waited 0.026s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:08:53 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-849f26bb-7814-4389-9a67-88957e092d87 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.366s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:53 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-849f26bb-7814-4389-9a67-88957e092d87 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:08:53 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-849f26bb-7814-4389-9a67-88957e092d87 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Deleted volume successfully. Sep 21 12:08:53 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acef2eb-e827-43bb-b642-b9eab0aefa52]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:08:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ed708d70-0117-40da-b36c-9429dfe6e765 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-62fd9516-e664-4a86-8d98-5932c1ae0443 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-849f26bb-7814-4389-9a67-88957e092d87 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "cinder-aba05781-38e9-4ae4-a16e-c2eb51ed062c-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:08:53 devstack sudo[103792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-62fd9516-e664-4a86-8d98-5932c1ae0443 Sep 21 12:08:53 devstack sudo[103792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:53 devstack sudo[103792]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ed708d70-0117-40da-b36c-9429dfe6e765 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-62fd9516-e664-4a86-8d98-5932c1ae0443" returned: 0 in 0.422s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ed708d70-0117-40da-b36c-9429dfe6e765 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-62fd9516-e664-4a86-8d98-5932c1ae0443 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:53 devstack sudo[103797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-62fd9516-e664-4a86-8d98-5932c1ae0443 Sep 21 12:08:53 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:54 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ed708d70-0117-40da-b36c-9429dfe6e765 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-62fd9516-e664-4a86-8d98-5932c1ae0443" returned: 0 in 0.277s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-ed708d70-0117-40da-b36c-9429dfe6e765 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "cinder-quobyte-62fd9516-e664-4a86-8d98-5932c1ae0443" released by "delete_volume" :: held 0.762s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:08:54 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-ed708d70-0117-40da-b36c-9429dfe6e765 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Created reservations ['15ffc1cd-1e35-47e8-b337-ee41e3efcaf7', '2f67e5e3-a4b3-4546-9b83-7dfe06c7bd2c', 'daccbdb7-c2f2-4c44-bf64-21ed1eabbddc', 'a5343284-1357-4de6-8695-9c37fbe4c113'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:08:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-ed708d70-0117-40da-b36c-9429dfe6e765 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-ed708d70-0117-40da-b36c-9429dfe6e765 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:54 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-ed708d70-0117-40da-b36c-9429dfe6e765 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:08:54 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-ed708d70-0117-40da-b36c-9429dfe6e765 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:08:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-ed708d70-0117-40da-b36c-9429dfe6e765 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ed708d70-0117-40da-b36c-9429dfe6e765 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:54 devstack sudo[103800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:08:54 devstack sudo[103800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4ee14b66-257a-4a21-8a41-11a7128fc106 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "cinder-01481b88-5efb-45d4-b187-fcfdd309ca75-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:08:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4ee14b66-257a-4a21-8a41-11a7128fc106 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "cinder-01481b88-5efb-45d4-b187-fcfdd309ca75-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:08:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4ee14b66-257a-4a21-8a41-11a7128fc106 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "cinder-quobyte-01481b88-5efb-45d4-b187-fcfdd309ca75" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:08:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4ee14b66-257a-4a21-8a41-11a7128fc106 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "cinder-quobyte-01481b88-5efb-45d4-b187-fcfdd309ca75" acquired by "delete_volume" :: waited 0.016s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:08:54 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dac82e4-bd7c-4cee-8adf-d204feb40880]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:08:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4ee14b66-257a-4a21-8a41-11a7128fc106 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-01481b88-5efb-45d4-b187-fcfdd309ca75 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:54 devstack sudo[103800]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ed708d70-0117-40da-b36c-9429dfe6e765 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.352s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:54 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-ed708d70-0117-40da-b36c-9429dfe6e765 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:08:54 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-ed708d70-0117-40da-b36c-9429dfe6e765 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Deleted volume successfully. Sep 21 12:08:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-ed708d70-0117-40da-b36c-9429dfe6e765 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "cinder-62fd9516-e664-4a86-8d98-5932c1ae0443-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:08:54 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-01481b88-5efb-45d4-b187-fcfdd309ca75 Sep 21 12:08:54 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:55 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4ee14b66-257a-4a21-8a41-11a7128fc106 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-01481b88-5efb-45d4-b187-fcfdd309ca75" returned: 0 in 0.420s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4ee14b66-257a-4a21-8a41-11a7128fc106 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-01481b88-5efb-45d4-b187-fcfdd309ca75 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:55 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-01481b88-5efb-45d4-b187-fcfdd309ca75 Sep 21 12:08:55 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:55 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4ee14b66-257a-4a21-8a41-11a7128fc106 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-01481b88-5efb-45d4-b187-fcfdd309ca75" returned: 0 in 0.260s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4ee14b66-257a-4a21-8a41-11a7128fc106 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "cinder-quobyte-01481b88-5efb-45d4-b187-fcfdd309ca75" released by "delete_volume" :: held 0.741s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:08:55 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-4ee14b66-257a-4a21-8a41-11a7128fc106 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Created reservations ['593bcefd-845a-430b-a844-abf9b4252449', 'a6970568-2d90-41ba-b7a5-024ec9f53bdb', '9ee4d58e-0940-450b-b2a8-092ef4d0d545', 'a3e71759-99de-4499-8059-35dc4b10f27b'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:08:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4ee14b66-257a-4a21-8a41-11a7128fc106 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:08:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4ee14b66-257a-4a21-8a41-11a7128fc106 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:08:55 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4ee14b66-257a-4a21-8a41-11a7128fc106 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:08:55 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4ee14b66-257a-4a21-8a41-11a7128fc106 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:08:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4ee14b66-257a-4a21-8a41-11a7128fc106 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:08:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4ee14b66-257a-4a21-8a41-11a7128fc106 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:08:55 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:08:55 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:08:55 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Sep 21 12:08:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4ee14b66-257a-4a21-8a41-11a7128fc106 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.258s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:08:55 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-4ee14b66-257a-4a21-8a41-11a7128fc106 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:08:55 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-4ee14b66-257a-4a21-8a41-11a7128fc106 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Deleted volume successfully. Sep 21 12:08:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4ee14b66-257a-4a21-8a41-11a7128fc106 tempest-CreateVolumesFromSourceVolumeTest-1216124231 None] Lock "cinder-01481b88-5efb-45d4-b187-fcfdd309ca75-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:09:01 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:09:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Flow 'volume_create_manager' (4ffbe1e9-2369-4b6a-a30f-e2146d889075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:09:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7046ee7e-67c3-4bfe-8374-ce1f8fcfbedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:09:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7046ee7e-67c3-4bfe-8374-ce1f8fcfbedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7fce761-aac1-49bd-885a-8cf90882e4e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaca214e00274be7b351fd7572c3dd92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:09:01Z,use_quota=True,user_id='3921ed6edb4047519e34dbd5fea7df58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:09:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df8e6be-c27f-44af-8799-993494effddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:09:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df8e6be-c27f-44af-8799-993494effddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:09:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd727f98-e40e-4a62-be4a-67454fc2ec4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:09:01 devstack cinder-volume[86366]: DEBUG cinder.image.glance [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Creating Keystone auth plugin from conf {{(pid=86366) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 21 12:09:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd727f98-e40e-4a62-be4a-67454fc2ec4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e7fce761-aac1-49bd-885a-8cf90882e4e3', 'volume_name': 'volume-e7fce761-aac1-49bd-885a-8cf90882e4e3', 'volume_size': 1, 'image_id': 'f3299ff4-c27f-41ec-8684-482843efc4f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f3299ff4-c27f-41ec-8684-482843efc4f2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f01616909264189b03f0cc3ec7f75509', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'aaca214e00274be7b351fd7572c3dd92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ec014d7c01d14374565d3703b28e538eca16152a5d70bd16f957fce5159443f1bf7d3d5fb36b205494f626e9fd5a6203bbdb09a7f125b926bcc71f8c5e5671c0', 'id': 'f3299ff4-c27f-41ec-8684-482843efc4f2', 'created_at': datetime.datetime(2026, 9, 21, 10, 8, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 10, 9, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f3299ff4-c27f-41ec-8684-482843efc4f2/file', 'properties': {}}, 'image_service': }' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:09:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2524f2-0847-478b-9080-a1fbbbe0175c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:09:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2524f2-0847-478b-9080-a1fbbbe0175c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:09:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa0aa09-adcd-4175-86cd-9d5eff7d8b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:09:01 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Volume e7fce761-aac1-49bd-885a-8cf90882e4e3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e7fce761-aac1-49bd-885a-8cf90882e4e3', 'volume_size': 1, 'image_id': 'f3299ff4-c27f-41ec-8684-482843efc4f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f3299ff4-c27f-41ec-8684-482843efc4f2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f01616909264189b03f0cc3ec7f75509', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'aaca214e00274be7b351fd7572c3dd92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ec014d7c01d14374565d3703b28e538eca16152a5d70bd16f957fce5159443f1bf7d3d5fb36b205494f626e9fd5a6203bbdb09a7f125b926bcc71f8c5e5671c0', 'id': 'f3299ff4-c27f-41ec-8684-482843efc4f2', 'created_at': datetime.datetime(2026, 9, 21, 10, 8, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 10, 9, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f3299ff4-c27f-41ec-8684-482843efc4f2/file', 'properties': {}}, 'image_service': } Sep 21 12:09:01 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Trying to clone e7fce761-aac1-49bd-885a-8cf90882e4e3 from image f3299ff4-c27f-41ec-8684-482843efc4f2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f3299ff4-c27f-41ec-8684-482843efc4f2', 'metadata': {}}]). {{(pid=86366) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 21 12:09:01 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f3299ff4-c27f-41ec-8684-482843efc4f2_9oruj0eydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 21 12:09:01 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Image download 0.00 MB at 0.00 MB/s Sep 21 12:09:01 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[368dffb0-d92d-4d61-be11-1f2a4ccf2761]: (4, 'raw') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:09:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f3299ff4-c27f-41ec-8684-482843efc4f2_9oruj0eydevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:02 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f3299ff4-c27f-41ec-8684-482843efc4f2_9oruj0eydevstack@QuobyteHD Sep 21 12:09:02 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:02 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f3299ff4-c27f-41ec-8684-482843efc4f2_9oruj0eydevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3299ff4-c27f-41ec-8684-482843efc4f2_9oruj0eydevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:02 devstack sudo[103865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3299ff4-c27f-41ec-8684-482843efc4f2_9oruj0eydevstack@QuobyteHD Sep 21 12:09:02 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:02 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3299ff4-c27f-41ec-8684-482843efc4f2_9oruj0eydevstack@QuobyteHD" returned: 1 in 0.330s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3299ff4-c27f-41ec-8684-482843efc4f2_9oruj0eydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 12:09:02 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Temporary image f3299ff4-c27f-41ec-8684-482843efc4f2 is fetched for user 3921ed6edb4047519e34dbd5fea7df58. {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 21 12:09:02 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[396ae1fa-8cdf-43a3-af35-7bc8edeae6ef]: (4, 'raw') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:09:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f3299ff4-c27f-41ec-8684-482843efc4f2_9oruj0eydevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:02 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f3299ff4-c27f-41ec-8684-482843efc4f2_9oruj0eydevstack@QuobyteHD Sep 21 12:09:02 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:02 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f3299ff4-c27f-41ec-8684-482843efc4f2_9oruj0eydevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3299ff4-c27f-41ec-8684-482843efc4f2_9oruj0eydevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:03 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3299ff4-c27f-41ec-8684-482843efc4f2_9oruj0eydevstack@QuobyteHD Sep 21 12:09:03 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:03 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3299ff4-c27f-41ec-8684-482843efc4f2_9oruj0eydevstack@QuobyteHD" returned: 1 in 0.321s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3299ff4-c27f-41ec-8684-482843efc4f2_9oruj0eydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 12:09:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:09:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:09:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7fce761-aac1-49bd-885a-8cf90882e4e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaca214e00274be7b351fd7572c3dd92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:09:01Z,use_quota=True,user_id='3921ed6edb4047519e34dbd5fea7df58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:09:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Creating volume e7fce761-aac1-49bd-885a-8cf90882e4e3 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:09:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:09:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:09:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:09:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:09:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:09:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:09:03 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:09:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7fce761-aac1-49bd-885a-8cf90882e4e3 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:03 devstack sudo[103879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7fce761-aac1-49bd-885a-8cf90882e4e3 1073741824 Sep 21 12:09:03 devstack sudo[103879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:03 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 12:09:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:09:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:09:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:09:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:09:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:09:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:03 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:09:03 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:03 devstack sudo[103879]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7fce761-aac1-49bd-885a-8cf90882e4e3 1073741824" returned: 0 in 0.540s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7fce761-aac1-49bd-885a-8cf90882e4e3 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:03 devstack sudo[103888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7fce761-aac1-49bd-885a-8cf90882e4e3 Sep 21 12:09:03 devstack sudo[103888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:04 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.289s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:04 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:09:04 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 12:09:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread count: 28 {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 12:09:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread info: [<_MainThread(MainThread, started 132841976594560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 12:09:04 devstack sudo[103888]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7fce761-aac1-49bd-885a-8cf90882e4e3" returned: 0 in 0.281s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:09:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:09:04 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Attempting download of f3299ff4-c27f-41ec-8684-482843efc4f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/f3299ff4-c27f-41ec-8684-482843efc4f2', 'metadata': {}}])) to volume e7fce761-aac1-49bd-885a-8cf90882e4e3. {{(pid=86366) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 21 12:09:04 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[86675798-6092-42e8-bbc0-2011d8b2bc00]: (4, 'raw') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:09:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f3299ff4-c27f-41ec-8684-482843efc4f2_40qc1h_2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:04 devstack sudo[103892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f3299ff4-c27f-41ec-8684-482843efc4f2_40qc1h_2 Sep 21 12:09:04 devstack sudo[103892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:04 devstack sudo[103892]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f3299ff4-c27f-41ec-8684-482843efc4f2_40qc1h_2" returned: 0 in 0.459s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3299ff4-c27f-41ec-8684-482843efc4f2_40qc1h_2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:04 devstack sudo[103902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3299ff4-c27f-41ec-8684-482843efc4f2_40qc1h_2 Sep 21 12:09:04 devstack sudo[103902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:05 devstack sudo[103902]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3299ff4-c27f-41ec-8684-482843efc4f2_40qc1h_2" returned: 1 in 0.404s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3299ff4-c27f-41ec-8684-482843efc4f2_40qc1h_2' failed. Not Retrying. {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 12:09:05 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6c73ee-a8cf-43b5-9f55-2059219edafe]: (4, 'raw') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:09:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f3299ff4-c27f-41ec-8684-482843efc4f2_9oruj0eydevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:05 devstack sudo[103906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f3299ff4-c27f-41ec-8684-482843efc4f2_9oruj0eydevstack@QuobyteHD Sep 21 12:09:05 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:05 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f3299ff4-c27f-41ec-8684-482843efc4f2_9oruj0eydevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3299ff4-c27f-41ec-8684-482843efc4f2_9oruj0eydevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:05 devstack sudo[103919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3299ff4-c27f-41ec-8684-482843efc4f2_9oruj0eydevstack@QuobyteHD Sep 21 12:09:05 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:06 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3299ff4-c27f-41ec-8684-482843efc4f2_9oruj0eydevstack@QuobyteHD" returned: 1 in 0.377s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f3299ff4-c27f-41ec-8684-482843efc4f2_9oruj0eydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 12:09:06 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] f3299ff4-c27f-41ec-8684-482843efc4f2 was raw, converting to qcow2 {{(pid=86366) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 21 12:09:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f3299ff4-c27f-41ec-8684-482843efc4f2_9oruj0eydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7fce761-aac1-49bd-885a-8cf90882e4e3 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:06 devstack sudo[103924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f3299ff4-c27f-41ec-8684-482843efc4f2_9oruj0eydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7fce761-aac1-49bd-885a-8cf90882e4e3 Sep 21 12:09:06 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:06 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f3299ff4-c27f-41ec-8684-482843efc4f2_9oruj0eydevstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7fce761-aac1-49bd-885a-8cf90882e4e3" returned: 0 in 0.512s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:06 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f3299ff4-c27f-41ec-8684-482843efc4f2_9oruj0eydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7fce761-aac1-49bd-885a-8cf90882e4e3 {{(pid=86366) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 12:09:06 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Converted 0.00 MB image at 0.00 MB/s Sep 21 12:09:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7fce761-aac1-49bd-885a-8cf90882e4e3 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:06 devstack sudo[103929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7fce761-aac1-49bd-885a-8cf90882e4e3 1G Sep 21 12:09:06 devstack sudo[103929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:06 devstack sudo[103929]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7fce761-aac1-49bd-885a-8cf90882e4e3 1G" returned: 0 in 0.316s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:06 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Downloaded image f3299ff4-c27f-41ec-8684-482843efc4f2 ((None, [{'url': 'file:///opt/stack/data/glance/images/f3299ff4-c27f-41ec-8684-482843efc4f2', 'metadata': {}}])) to volume e7fce761-aac1-49bd-885a-8cf90882e4e3 successfully. {{(pid=86366) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 21 12:09:06 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Temporary image f3299ff4-c27f-41ec-8684-482843efc4f2 for user 3921ed6edb4047519e34dbd5fea7df58 is deleted. {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 21 12:09:06 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Marking volume e7fce761-aac1-49bd-885a-8cf90882e4e3 as bootable. {{(pid=86366) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 21 12:09:06 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:UPDATE=141,cinder:SELECT=111,cinder:INSERT=43,cinder:DELETE=9 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:09:06 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Copying metadata from image f3299ff4-c27f-41ec-8684-482843efc4f2 to e7fce761-aac1-49bd-885a-8cf90882e4e3. {{(pid=86366) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 21 12:09:06 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Creating volume glance metadata for volume e7fce761-aac1-49bd-885a-8cf90882e4e3 backed by image f3299ff4-c27f-41ec-8684-482843efc4f2 with: {'image_id': 'f3299ff4-c27f-41ec-8684-482843efc4f2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f01616909264189b03f0cc3ec7f75509', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86366) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 21 12:09:06 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=108,cinder:INSERT=43,cinder:UPDATE=144,cinder:DELETE=16 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:09:06 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa0aa09-adcd-4175-86cd-9d5eff7d8b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7fce761-aac1-49bd-885a-8cf90882e4e3', 'volume_size': 1, 'image_id': 'f3299ff4-c27f-41ec-8684-482843efc4f2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f3299ff4-c27f-41ec-8684-482843efc4f2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f01616909264189b03f0cc3ec7f75509', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'aaca214e00274be7b351fd7572c3dd92', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ec014d7c01d14374565d3703b28e538eca16152a5d70bd16f957fce5159443f1bf7d3d5fb36b205494f626e9fd5a6203bbdb09a7f125b926bcc71f8c5e5671c0', 'id': 'f3299ff4-c27f-41ec-8684-482843efc4f2', 'created_at': datetime.datetime(2026, 9, 21, 10, 8, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 10, 9, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f3299ff4-c27f-41ec-8684-482843efc4f2/file', 'properties': {}}, 'image_service': }' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:09:06 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9804eebe-e9a9-4709-9620-a6d2fb88f5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:09:06 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Volume volume-e7fce761-aac1-49bd-885a-8cf90882e4e3 (e7fce761-aac1-49bd-885a-8cf90882e4e3): created successfully Sep 21 12:09:06 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9804eebe-e9a9-4709-9620-a6d2fb88f5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:09:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Flow 'volume_create_manager' (4ffbe1e9-2369-4b6a-a30f-e2146d889075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:09:07 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-40bbcde1-ff89-47c3-97f1-91a9a0cce0ac tempest-VolumeImageDependencyTests-1820920026 None] Created volume successfully. Sep 21 12:09:07 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fe8c598a-82a6-4b86-8f73-a5c64d226388 tempest-VolumeImageDependencyTests-1820920026 None] Acquiring lock "cinder-e7fce761-aac1-49bd-885a-8cf90882e4e3-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:09:07 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fe8c598a-82a6-4b86-8f73-a5c64d226388 tempest-VolumeImageDependencyTests-1820920026 None] Lock "cinder-e7fce761-aac1-49bd-885a-8cf90882e4e3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:09:07 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fe8c598a-82a6-4b86-8f73-a5c64d226388 tempest-VolumeImageDependencyTests-1820920026 None] Acquiring lock "cinder-quobyte-e7fce761-aac1-49bd-885a-8cf90882e4e3" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:09:07 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fe8c598a-82a6-4b86-8f73-a5c64d226388 tempest-VolumeImageDependencyTests-1820920026 None] Lock "cinder-quobyte-e7fce761-aac1-49bd-885a-8cf90882e4e3" acquired by "delete_volume" :: waited 0.015s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:09:07 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[930e7b25-e2f6-48ca-870c-13a7817b33d7]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:09:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fe8c598a-82a6-4b86-8f73-a5c64d226388 tempest-VolumeImageDependencyTests-1820920026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7fce761-aac1-49bd-885a-8cf90882e4e3 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:08 devstack sudo[103959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7fce761-aac1-49bd-885a-8cf90882e4e3 Sep 21 12:09:08 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:08 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fe8c598a-82a6-4b86-8f73-a5c64d226388 tempest-VolumeImageDependencyTests-1820920026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7fce761-aac1-49bd-885a-8cf90882e4e3" returned: 0 in 0.411s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fe8c598a-82a6-4b86-8f73-a5c64d226388 tempest-VolumeImageDependencyTests-1820920026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7fce761-aac1-49bd-885a-8cf90882e4e3 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:08 devstack sudo[103964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7fce761-aac1-49bd-885a-8cf90882e4e3 Sep 21 12:09:08 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:08 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fe8c598a-82a6-4b86-8f73-a5c64d226388 tempest-VolumeImageDependencyTests-1820920026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e7fce761-aac1-49bd-885a-8cf90882e4e3" returned: 0 in 0.261s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:08 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fe8c598a-82a6-4b86-8f73-a5c64d226388 tempest-VolumeImageDependencyTests-1820920026 None] Lock "cinder-quobyte-e7fce761-aac1-49bd-885a-8cf90882e4e3" released by "delete_volume" :: held 0.720s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:09:08 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-fe8c598a-82a6-4b86-8f73-a5c64d226388 tempest-VolumeImageDependencyTests-1820920026 None] Created reservations ['17736455-37d4-4ff9-8dad-a025bc576e9c', '6728f0fe-779e-4ed6-9175-7c2eb677ccc3', '7d9e9239-9af4-4e3a-9fb0-1252ad005ee1', '9f635cf9-4388-4ab1-99a5-5a4bd05999e0'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:09:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fe8c598a-82a6-4b86-8f73-a5c64d226388 tempest-VolumeImageDependencyTests-1820920026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:09:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fe8c598a-82a6-4b86-8f73-a5c64d226388 tempest-VolumeImageDependencyTests-1820920026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:09:08 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fe8c598a-82a6-4b86-8f73-a5c64d226388 tempest-VolumeImageDependencyTests-1820920026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:09:08 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fe8c598a-82a6-4b86-8f73-a5c64d226388 tempest-VolumeImageDependencyTests-1820920026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:09:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fe8c598a-82a6-4b86-8f73-a5c64d226388 tempest-VolumeImageDependencyTests-1820920026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:09:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fe8c598a-82a6-4b86-8f73-a5c64d226388 tempest-VolumeImageDependencyTests-1820920026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:08 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:09:08 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:09 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fe8c598a-82a6-4b86-8f73-a5c64d226388 tempest-VolumeImageDependencyTests-1820920026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.289s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:09 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-fe8c598a-82a6-4b86-8f73-a5c64d226388 tempest-VolumeImageDependencyTests-1820920026 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:09:09 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-fe8c598a-82a6-4b86-8f73-a5c64d226388 tempest-VolumeImageDependencyTests-1820920026 None] Deleted volume successfully. Sep 21 12:09:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fe8c598a-82a6-4b86-8f73-a5c64d226388 tempest-VolumeImageDependencyTests-1820920026 None] Lock "cinder-e7fce761-aac1-49bd-885a-8cf90882e4e3-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Flow 'volume_create_manager' (d8e248b3-62c0-4b80-b6c7-5518ed265415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (860d2c4b-e533-413d-90d3-321335b1fe70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (860d2c4b-e533-413d-90d3-321335b1fe70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1589257303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b10add-b4b6-487f-bcf1-dcd03745d5e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7659f9007a2b4e22ab1070a597719cbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:09:13Z,use_quota=True,user_id='8b18ba1dfbb447b09d445d9b789f1d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe24e3ed-70d5-4b21-805a-403b86bd8be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe24e3ed-70d5-4b21-805a-403b86bd8be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16f1d177-a246-4e00-9610-b62a22c5d920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16f1d177-a246-4e00-9610-b62a22c5d920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77b10add-b4b6-487f-bcf1-dcd03745d5e3', 'volume_name': 'volume-77b10add-b4b6-487f-bcf1-dcd03745d5e3', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8978c1d1-5482-4214-93a7-cdb3b576dfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8978c1d1-5482-4214-93a7-cdb3b576dfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21ed82e-1906-47c0-90d4-54dff482c7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:09:13 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Volume 77b10add-b4b6-487f-bcf1-dcd03745d5e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77b10add-b4b6-487f-bcf1-dcd03745d5e3', 'volume_size': 1} Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1589257303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b10add-b4b6-487f-bcf1-dcd03745d5e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7659f9007a2b4e22ab1070a597719cbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:09:13Z,use_quota=True,user_id='8b18ba1dfbb447b09d445d9b789f1d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Creating volume 77b10add-b4b6-487f-bcf1-dcd03745d5e3 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:09:13 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-77b10add-b4b6-487f-bcf1-dcd03745d5e3 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:13 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-77b10add-b4b6-487f-bcf1-dcd03745d5e3 1073741824 Sep 21 12:09:13 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:13 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-77b10add-b4b6-487f-bcf1-dcd03745d5e3 1073741824" returned: 0 in 0.455s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-77b10add-b4b6-487f-bcf1-dcd03745d5e3 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:13 devstack sudo[103979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-77b10add-b4b6-487f-bcf1-dcd03745d5e3 Sep 21 12:09:13 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:13 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-77b10add-b4b6-487f-bcf1-dcd03745d5e3" returned: 0 in 0.254s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21ed82e-1906-47c0-90d4-54dff482c7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77b10add-b4b6-487f-bcf1-dcd03745d5e3', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0695bb37-2250-4201-bcd8-78d0fd326dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:09:13 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Volume volume-77b10add-b4b6-487f-bcf1-dcd03745d5e3 (77b10add-b4b6-487f-bcf1-dcd03745d5e3): created successfully Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0695bb37-2250-4201-bcd8-78d0fd326dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:09:13 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Flow 'volume_create_manager' (d8e248b3-62c0-4b80-b6c7-5518ed265415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:09:13 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-b6ed5103-b992-4cb7-88b0-7e7dffb08787 tempest-ProjectReaderTests-915215255 None] Created volume successfully. Sep 21 12:09:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-96ada92f-f464-43cd-8424-8941d7272004 tempest-ProjectReaderTests-915215255 None] Acquiring lock "cinder-77b10add-b4b6-487f-bcf1-dcd03745d5e3-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:09:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-96ada92f-f464-43cd-8424-8941d7272004 tempest-ProjectReaderTests-915215255 None] Lock "cinder-77b10add-b4b6-487f-bcf1-dcd03745d5e3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:09:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-96ada92f-f464-43cd-8424-8941d7272004 tempest-ProjectReaderTests-915215255 None] Acquiring lock "cinder-quobyte-77b10add-b4b6-487f-bcf1-dcd03745d5e3" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:09:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-96ada92f-f464-43cd-8424-8941d7272004 tempest-ProjectReaderTests-915215255 None] Lock "cinder-quobyte-77b10add-b4b6-487f-bcf1-dcd03745d5e3" acquired by "delete_volume" :: waited 0.014s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:09:14 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[06214508-346f-4825-b913-9673b59ff0f9]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:09:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-96ada92f-f464-43cd-8424-8941d7272004 tempest-ProjectReaderTests-915215255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-77b10add-b4b6-487f-bcf1-dcd03745d5e3 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:14 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-77b10add-b4b6-487f-bcf1-dcd03745d5e3 Sep 21 12:09:14 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:14 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-96ada92f-f464-43cd-8424-8941d7272004 tempest-ProjectReaderTests-915215255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-77b10add-b4b6-487f-bcf1-dcd03745d5e3" returned: 0 in 0.376s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-96ada92f-f464-43cd-8424-8941d7272004 tempest-ProjectReaderTests-915215255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-77b10add-b4b6-487f-bcf1-dcd03745d5e3 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:14 devstack sudo[103989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-77b10add-b4b6-487f-bcf1-dcd03745d5e3 Sep 21 12:09:14 devstack sudo[103989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:14 devstack sudo[103989]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-96ada92f-f464-43cd-8424-8941d7272004 tempest-ProjectReaderTests-915215255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-77b10add-b4b6-487f-bcf1-dcd03745d5e3" returned: 0 in 0.262s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-96ada92f-f464-43cd-8424-8941d7272004 tempest-ProjectReaderTests-915215255 None] Lock "cinder-quobyte-77b10add-b4b6-487f-bcf1-dcd03745d5e3" released by "delete_volume" :: held 0.680s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:09:14 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-96ada92f-f464-43cd-8424-8941d7272004 tempest-ProjectReaderTests-915215255 None] Created reservations ['c1fb2c62-15ca-4bca-8327-341bf2b4e9ed', '39db800d-ef56-40fb-93ce-453c21a82897', '1bf11a84-94e7-4d8c-9ac9-f2ea67b092b3', '6e2ac861-4a34-4e7e-9fb8-b0357c28c9f0'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:09:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-96ada92f-f464-43cd-8424-8941d7272004 tempest-ProjectReaderTests-915215255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:09:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-96ada92f-f464-43cd-8424-8941d7272004 tempest-ProjectReaderTests-915215255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:09:15 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-96ada92f-f464-43cd-8424-8941d7272004 tempest-ProjectReaderTests-915215255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:09:15 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-96ada92f-f464-43cd-8424-8941d7272004 tempest-ProjectReaderTests-915215255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:09:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-96ada92f-f464-43cd-8424-8941d7272004 tempest-ProjectReaderTests-915215255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:09:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-96ada92f-f464-43cd-8424-8941d7272004 tempest-ProjectReaderTests-915215255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:15 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:09:15 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:15 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-96ada92f-f464-43cd-8424-8941d7272004 tempest-ProjectReaderTests-915215255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.319s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:15 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-96ada92f-f464-43cd-8424-8941d7272004 tempest-ProjectReaderTests-915215255 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:09:15 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-96ada92f-f464-43cd-8424-8941d7272004 tempest-ProjectReaderTests-915215255 None] Deleted volume successfully. Sep 21 12:09:15 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-96ada92f-f464-43cd-8424-8941d7272004 tempest-ProjectReaderTests-915215255 None] Lock "cinder-77b10add-b4b6-487f-bcf1-dcd03745d5e3-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:09:15 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:09:15 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Flow 'volume_create_manager' (eef35569-a3e5-4e33-be3b-30a20ba4e84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:09:15 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7536ed16-b97e-4806-825a-f1bfacd2d282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:09:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7536ed16-b97e-4806-825a-f1bfacd2d282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1760318755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60134b8a-51fb-4b1f-983d-3e055b0539f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7659f9007a2b4e22ab1070a597719cbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:09:16Z,use_quota=True,user_id='8b18ba1dfbb447b09d445d9b789f1d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:09:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d8e93b-e27f-43f6-9da6-3ddd8fe5b951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:09:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d8e93b-e27f-43f6-9da6-3ddd8fe5b951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:09:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830858ae-157a-422f-bfc2-89a4f7813a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:09:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830858ae-157a-422f-bfc2-89a4f7813a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60134b8a-51fb-4b1f-983d-3e055b0539f8', 'volume_name': 'volume-60134b8a-51fb-4b1f-983d-3e055b0539f8', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:09:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece0c1e9-2c54-4e7c-9a28-13ada9dadbaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:09:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ece0c1e9-2c54-4e7c-9a28-13ada9dadbaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:09:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94401d39-7dac-4f54-8efb-0f20ec14833e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:09:16 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Volume 60134b8a-51fb-4b1f-983d-3e055b0539f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60134b8a-51fb-4b1f-983d-3e055b0539f8', 'volume_size': 1} Sep 21 12:09:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:09:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:09:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1760318755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60134b8a-51fb-4b1f-983d-3e055b0539f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7659f9007a2b4e22ab1070a597719cbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:09:16Z,use_quota=True,user_id='8b18ba1dfbb447b09d445d9b789f1d7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:09:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Creating volume 60134b8a-51fb-4b1f-983d-3e055b0539f8 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:09:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:09:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:09:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:09:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:09:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:09:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:09:16 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:09:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-60134b8a-51fb-4b1f-983d-3e055b0539f8 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:16 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-60134b8a-51fb-4b1f-983d-3e055b0539f8 1073741824 Sep 21 12:09:16 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:16 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-60134b8a-51fb-4b1f-983d-3e055b0539f8 1073741824" returned: 0 in 0.518s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-60134b8a-51fb-4b1f-983d-3e055b0539f8 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:16 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-60134b8a-51fb-4b1f-983d-3e055b0539f8 Sep 21 12:09:16 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:16 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-60134b8a-51fb-4b1f-983d-3e055b0539f8" returned: 0 in 0.338s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:09:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:09:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94401d39-7dac-4f54-8efb-0f20ec14833e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60134b8a-51fb-4b1f-983d-3e055b0539f8', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:09:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (676209f4-3301-4060-ae6d-7120a1ebdd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:09:16 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Volume volume-60134b8a-51fb-4b1f-983d-3e055b0539f8 (60134b8a-51fb-4b1f-983d-3e055b0539f8): created successfully Sep 21 12:09:16 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (676209f4-3301-4060-ae6d-7120a1ebdd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:09:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Flow 'volume_create_manager' (eef35569-a3e5-4e33-be3b-30a20ba4e84e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:09:17 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-8a935b80-b9e1-45b0-832f-847f93db3c69 tempest-ProjectReaderTests-915215255 None] Created volume successfully. Sep 21 12:09:17 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-d2d4466c-464f-4d61-8c62-b8768d453d8d req-75643e1e-7bd6-4642-af88-25a7cf212310 tempest-TestShelveInstance-363078156 None] Terminate volume connection completed successfully. Sep 21 12:09:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-d2d4466c-464f-4d61-8c62-b8768d453d8d req-75643e1e-7bd6-4642-af88-25a7cf212310 tempest-TestShelveInstance-363078156 None] Deleting attachment ec32153e-d3c0-45b8-aa0d-60fe9c185c0f. {{(pid=86366) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 12:09:18 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-91fddddf-2d9b-4de2-a5bc-d8f21f980cff tempest-ProjectReaderTests-915215255 None] Acquiring lock "cinder-60134b8a-51fb-4b1f-983d-3e055b0539f8-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:09:18 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-91fddddf-2d9b-4de2-a5bc-d8f21f980cff tempest-ProjectReaderTests-915215255 None] Lock "cinder-60134b8a-51fb-4b1f-983d-3e055b0539f8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:09:18 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-91fddddf-2d9b-4de2-a5bc-d8f21f980cff tempest-ProjectReaderTests-915215255 None] Acquiring lock "cinder-quobyte-60134b8a-51fb-4b1f-983d-3e055b0539f8" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:09:18 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-91fddddf-2d9b-4de2-a5bc-d8f21f980cff tempest-ProjectReaderTests-915215255 None] Lock "cinder-quobyte-60134b8a-51fb-4b1f-983d-3e055b0539f8" acquired by "delete_volume" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:09:18 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b13acfe-e13d-4da7-a163-f1fdeae0dc90]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:09:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-91fddddf-2d9b-4de2-a5bc-d8f21f980cff tempest-ProjectReaderTests-915215255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-60134b8a-51fb-4b1f-983d-3e055b0539f8 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:18 devstack sudo[104032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-60134b8a-51fb-4b1f-983d-3e055b0539f8 Sep 21 12:09:18 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:18 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-91fddddf-2d9b-4de2-a5bc-d8f21f980cff tempest-ProjectReaderTests-915215255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-60134b8a-51fb-4b1f-983d-3e055b0539f8" returned: 0 in 0.447s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-91fddddf-2d9b-4de2-a5bc-d8f21f980cff tempest-ProjectReaderTests-915215255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-60134b8a-51fb-4b1f-983d-3e055b0539f8 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:18 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-60134b8a-51fb-4b1f-983d-3e055b0539f8 Sep 21 12:09:18 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:19 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-91fddddf-2d9b-4de2-a5bc-d8f21f980cff tempest-ProjectReaderTests-915215255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-60134b8a-51fb-4b1f-983d-3e055b0539f8" returned: 0 in 0.247s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-91fddddf-2d9b-4de2-a5bc-d8f21f980cff tempest-ProjectReaderTests-915215255 None] Lock "cinder-quobyte-60134b8a-51fb-4b1f-983d-3e055b0539f8" released by "delete_volume" :: held 0.752s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:09:19 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-91fddddf-2d9b-4de2-a5bc-d8f21f980cff tempest-ProjectReaderTests-915215255 None] Created reservations ['2670e533-4ff2-4370-b9cb-cd531cbf8c19', 'fc4d5295-dfc0-4a6d-a1d3-80c7ecfa5fd1', 'e74fb59f-0f28-4b59-8249-b1fd1a884ad6', '30fcd21b-de05-40d7-b4c3-ae9e721d2a44'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:09:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-91fddddf-2d9b-4de2-a5bc-d8f21f980cff tempest-ProjectReaderTests-915215255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:09:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-91fddddf-2d9b-4de2-a5bc-d8f21f980cff tempest-ProjectReaderTests-915215255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:09:19 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-91fddddf-2d9b-4de2-a5bc-d8f21f980cff tempest-ProjectReaderTests-915215255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:09:19 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-91fddddf-2d9b-4de2-a5bc-d8f21f980cff tempest-ProjectReaderTests-915215255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:09:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-91fddddf-2d9b-4de2-a5bc-d8f21f980cff tempest-ProjectReaderTests-915215255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:09:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-91fddddf-2d9b-4de2-a5bc-d8f21f980cff tempest-ProjectReaderTests-915215255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:19 devstack sudo[104043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:09:19 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:19 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-91fddddf-2d9b-4de2-a5bc-d8f21f980cff tempest-ProjectReaderTests-915215255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.278s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:19 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-91fddddf-2d9b-4de2-a5bc-d8f21f980cff tempest-ProjectReaderTests-915215255 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:09:19 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-91fddddf-2d9b-4de2-a5bc-d8f21f980cff tempest-ProjectReaderTests-915215255 None] Deleted volume successfully. Sep 21 12:09:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-91fddddf-2d9b-4de2-a5bc-d8f21f980cff tempest-ProjectReaderTests-915215255 None] Lock "cinder-60134b8a-51fb-4b1f-983d-3e055b0539f8-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:09:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-4d0eda2d-653f-4650-9ddf-44d2eb0c2d89 req-540f9868-1996-452b-bbf7-784645e508bc tempest-TestShelveInstance-363078156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:09:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-4d0eda2d-653f-4650-9ddf-44d2eb0c2d89 req-540f9868-1996-452b-bbf7-784645e508bc tempest-TestShelveInstance-363078156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:09:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-4d0eda2d-653f-4650-9ddf-44d2eb0c2d89 req-540f9868-1996-452b-bbf7-784645e508bc tempest-TestShelveInstance-363078156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:09:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-4d0eda2d-653f-4650-9ddf-44d2eb0c2d89 req-540f9868-1996-452b-bbf7-784645e508bc tempest-TestShelveInstance-363078156 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d', 'name': 'volume-ddba65eb-3e75-4cc4-a67c-3fc751fac234', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc0c26dc-1c77-43c8-8584-5fe84063cac1', 'enforce_multipath': True} {{(pid=86366) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 21 12:09:20 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-4d0eda2d-653f-4650-9ddf-44d2eb0c2d89 req-540f9868-1996-452b-bbf7-784645e508bc tempest-TestShelveInstance-363078156 None] attachment_update completed successfully. Sep 21 12:09:30 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=29,cinder:INSERT=7,cinder:UPDATE=34,cinder:DELETE=2 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:09:30 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=32,cinder:INSERT=15,cinder:DELETE=4,cinder:UPDATE=32 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:09:50 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-66ed6978-31ba-44a0-a23c-18301c3fcfba req-698444dc-54d0-4287-92f0-2b52f3f70d1f tempest-TestShelveInstance-363078156 None] Terminate volume connection completed successfully. Sep 21 12:09:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [req-66ed6978-31ba-44a0-a23c-18301c3fcfba req-698444dc-54d0-4287-92f0-2b52f3f70d1f tempest-TestShelveInstance-363078156 None] Deleting attachment dc0c26dc-1c77-43c8-8584-5fe84063cac1. {{(pid=86366) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 21 12:09:50 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-66ed6978-31ba-44a0-a23c-18301c3fcfba req-a21c4eb4-75df-4253-bc2f-1e93c4d3cbe7 tempest-TestShelveInstance-363078156 None] Acquiring lock "cinder-ddba65eb-3e75-4cc4-a67c-3fc751fac234-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:09:50 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-66ed6978-31ba-44a0-a23c-18301c3fcfba req-a21c4eb4-75df-4253-bc2f-1e93c4d3cbe7 tempest-TestShelveInstance-363078156 None] Lock "cinder-ddba65eb-3e75-4cc4-a67c-3fc751fac234-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:09:50 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-66ed6978-31ba-44a0-a23c-18301c3fcfba req-a21c4eb4-75df-4253-bc2f-1e93c4d3cbe7 tempest-TestShelveInstance-363078156 None] Acquiring lock "cinder-quobyte-ddba65eb-3e75-4cc4-a67c-3fc751fac234" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:09:50 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-66ed6978-31ba-44a0-a23c-18301c3fcfba req-a21c4eb4-75df-4253-bc2f-1e93c4d3cbe7 tempest-TestShelveInstance-363078156 None] Lock "cinder-quobyte-ddba65eb-3e75-4cc4-a67c-3fc751fac234" acquired by "delete_volume" :: waited 0.017s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:09:50 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2b9509-caac-4576-bc24-2fd19f6636f4]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:09:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-66ed6978-31ba-44a0-a23c-18301c3fcfba req-a21c4eb4-75df-4253-bc2f-1e93c4d3cbe7 tempest-TestShelveInstance-363078156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ddba65eb-3e75-4cc4-a67c-3fc751fac234 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:50 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ddba65eb-3e75-4cc4-a67c-3fc751fac234 Sep 21 12:09:50 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:50 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-66ed6978-31ba-44a0-a23c-18301c3fcfba req-a21c4eb4-75df-4253-bc2f-1e93c4d3cbe7 tempest-TestShelveInstance-363078156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ddba65eb-3e75-4cc4-a67c-3fc751fac234" returned: 0 in 0.421s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-66ed6978-31ba-44a0-a23c-18301c3fcfba req-a21c4eb4-75df-4253-bc2f-1e93c4d3cbe7 tempest-TestShelveInstance-363078156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ddba65eb-3e75-4cc4-a67c-3fc751fac234 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:50 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ddba65eb-3e75-4cc4-a67c-3fc751fac234 Sep 21 12:09:50 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:51 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-66ed6978-31ba-44a0-a23c-18301c3fcfba req-a21c4eb4-75df-4253-bc2f-1e93c4d3cbe7 tempest-TestShelveInstance-363078156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ddba65eb-3e75-4cc4-a67c-3fc751fac234" returned: 0 in 0.252s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:51 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-66ed6978-31ba-44a0-a23c-18301c3fcfba req-a21c4eb4-75df-4253-bc2f-1e93c4d3cbe7 tempest-TestShelveInstance-363078156 None] Lock "cinder-quobyte-ddba65eb-3e75-4cc4-a67c-3fc751fac234" released by "delete_volume" :: held 0.729s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:09:51 devstack cinder-volume[86366]: DEBUG cinder.quota [req-66ed6978-31ba-44a0-a23c-18301c3fcfba req-a21c4eb4-75df-4253-bc2f-1e93c4d3cbe7 tempest-TestShelveInstance-363078156 None] Created reservations ['1a60f0a3-e306-467c-aae7-1da2553bf4bf', 'd0649e4d-08ec-49d6-9466-9f67e10a20e6', 'c9ea1f2e-0fe4-430e-b508-955dd4ee24cb', '6951645c-8f7a-4193-a778-3a4236ab3e48'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:09:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-66ed6978-31ba-44a0-a23c-18301c3fcfba req-a21c4eb4-75df-4253-bc2f-1e93c4d3cbe7 tempest-TestShelveInstance-363078156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:09:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-66ed6978-31ba-44a0-a23c-18301c3fcfba req-a21c4eb4-75df-4253-bc2f-1e93c4d3cbe7 tempest-TestShelveInstance-363078156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:09:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [req-66ed6978-31ba-44a0-a23c-18301c3fcfba req-a21c4eb4-75df-4253-bc2f-1e93c4d3cbe7 tempest-TestShelveInstance-363078156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:09:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [req-66ed6978-31ba-44a0-a23c-18301c3fcfba req-a21c4eb4-75df-4253-bc2f-1e93c4d3cbe7 tempest-TestShelveInstance-363078156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:09:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [req-66ed6978-31ba-44a0-a23c-18301c3fcfba req-a21c4eb4-75df-4253-bc2f-1e93c4d3cbe7 tempest-TestShelveInstance-363078156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:09:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-66ed6978-31ba-44a0-a23c-18301c3fcfba req-a21c4eb4-75df-4253-bc2f-1e93c4d3cbe7 tempest-TestShelveInstance-363078156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:09:51 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:09:51 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:09:51 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Sep 21 12:09:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [req-66ed6978-31ba-44a0-a23c-18301c3fcfba req-a21c4eb4-75df-4253-bc2f-1e93c4d3cbe7 tempest-TestShelveInstance-363078156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.308s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:09:51 devstack cinder-volume[86366]: DEBUG cinder.manager [req-66ed6978-31ba-44a0-a23c-18301c3fcfba req-a21c4eb4-75df-4253-bc2f-1e93c4d3cbe7 tempest-TestShelveInstance-363078156 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:09:51 devstack cinder-volume[86366]: INFO cinder.volume.manager [req-66ed6978-31ba-44a0-a23c-18301c3fcfba req-a21c4eb4-75df-4253-bc2f-1e93c4d3cbe7 tempest-TestShelveInstance-363078156 None] Deleted volume successfully. Sep 21 12:09:51 devstack cinder-volume[86366]: DEBUG cinder.coordination [req-66ed6978-31ba-44a0-a23c-18301c3fcfba req-a21c4eb4-75df-4253-bc2f-1e93c4d3cbe7 tempest-TestShelveInstance-363078156 None] Lock "cinder-ddba65eb-3e75-4cc4-a67c-3fc751fac234-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:01 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=9,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:10:01 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:UPDATE=9,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:10:03 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 12:10:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread count: 28 {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 12:10:03 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread info: [<_MainThread(MainThread, started 132841976594560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Flow 'volume_create_manager' (02c0873f-431b-4995-aea5-11fbfabf7618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5f8b54-c555-4fa6-96f8-38dae13d8e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5f8b54-c555-4fa6-96f8-38dae13d8e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-705610173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a7d833-a65a-497b-8aff-133d901f0501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a4a5d58f0ab408cb65c441a42a45ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:19Z,use_quota=True,user_id='72fd573c46d04ca1a268ad1ef2b41ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (909ed14a-9616-4cdf-8074-5b3cc43dfdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (909ed14a-9616-4cdf-8074-5b3cc43dfdbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d516d06e-a376-429e-abef-aa70c781f7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d516d06e-a376-429e-abef-aa70c781f7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0a7d833-a65a-497b-8aff-133d901f0501', 'volume_name': 'volume-e0a7d833-a65a-497b-8aff-133d901f0501', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91be9f7a-c20f-4c42-a9ba-401b2194d3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91be9f7a-c20f-4c42-a9ba-401b2194d3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (012ead4a-6608-4986-985a-6c25c40c12a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:19 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Volume e0a7d833-a65a-497b-8aff-133d901f0501: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0a7d833-a65a-497b-8aff-133d901f0501', 'volume_size': 1} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-705610173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a7d833-a65a-497b-8aff-133d901f0501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a4a5d58f0ab408cb65c441a42a45ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:19Z,use_quota=True,user_id='72fd573c46d04ca1a268ad1ef2b41ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Creating volume e0a7d833-a65a-497b-8aff-133d901f0501 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:10:19 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:19 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501 1073741824 Sep 21 12:10:19 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Flow 'volume_create_manager' (f2dd7010-67e5-4d8b-9b7f-2a9c0a2ea19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (132110a2-cb0d-4fb9-9426-e67410bb2669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (132110a2-cb0d-4fb9-9426-e67410bb2669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1085280773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ea0548a-1d73-4f9c-badd-61dce6a2e0b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc0b76caf05940bc91b32f4dc6a48cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:20Z,use_quota=True,user_id='8f5ff040483349a0aa9e555fd0a4614a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b20970b1-c178-48b7-aaf8-c7db108dc3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b20970b1-c178-48b7-aaf8-c7db108dc3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf04b76f-63f1-4266-a42c-249a3822a2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf04b76f-63f1-4266-a42c-249a3822a2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ea0548a-1d73-4f9c-badd-61dce6a2e0b0', 'volume_name': 'volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (187c2273-f53b-4bc6-9e63-192f10b1cd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (187c2273-f53b-4bc6-9e63-192f10b1cd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a5d065-91ca-47c5-a79f-beaa8a435786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:19 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Volume 0ea0548a-1d73-4f9c-badd-61dce6a2e0b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0', 'volume_size': 1} Sep 21 12:10:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:20 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501 1073741824" returned: 0 in 0.577s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:20 devstack sudo[104721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501 Sep 21 12:10:20 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:20 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501" returned: 0 in 0.333s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:10:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.595s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1085280773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ea0548a-1d73-4f9c-badd-61dce6a2e0b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc0b76caf05940bc91b32f4dc6a48cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:20Z,use_quota=True,user_id='8f5ff040483349a0aa9e555fd0a4614a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:10:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Creating volume 0ea0548a-1d73-4f9c-badd-61dce6a2e0b0 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:10:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:10:20 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:10:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (012ead4a-6608-4986-985a-6c25c40c12a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0a7d833-a65a-497b-8aff-133d901f0501', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:20 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0 1073741824 Sep 21 12:10:20 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a9c971-24de-4d11-9804-3649455ee5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:20 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Volume volume-e0a7d833-a65a-497b-8aff-133d901f0501 (e0a7d833-a65a-497b-8aff-133d901f0501): created successfully Sep 21 12:10:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a9c971-24de-4d11-9804-3649455ee5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Flow 'volume_create_manager' (02c0873f-431b-4995-aea5-11fbfabf7618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:20 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-a30cd0dc-7702-4c3e-a96c-8e211d3c06f1 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Created volume successfully. Sep 21 12:10:21 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0 1073741824" returned: 0 in 0.680s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:21 devstack sudo[104732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0 Sep 21 12:10:21 devstack sudo[104732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:21 devstack sudo[104732]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0" returned: 0 in 0.328s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:21 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:10:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a5d065-91ca-47c5-a79f-beaa8a435786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9a8724-7911-413b-a2b5-e58422ae8652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:21 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Volume volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0 (0ea0548a-1d73-4f9c-badd-61dce6a2e0b0): created successfully Sep 21 12:10:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9a8724-7911-413b-a2b5-e58422ae8652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Flow 'volume_create_manager' (f2dd7010-67e5-4d8b-9b7f-2a9c0a2ea19e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:21 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-9c22975e-3a33-48ab-b1ae-904cc2576378 tempest-VolumeDependencyTests-1245787338 None] Created volume successfully. Sep 21 12:10:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-34b77789-f40e-4aed-bcb8-ffc87b398289 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-34b77789-f40e-4aed-bcb8-ffc87b398289 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:21 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-34b77789-f40e-4aed-bcb8-ffc87b398289 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Creating offline snapshot 590d3003-1d02-488e-a253-dbc86f36b063 of volume e0a7d833-a65a-497b-8aff-133d901f0501 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:10:21 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[212bf8c2-35f1-47e6-9b34-3981fd3c6b3c]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:10:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-34b77789-f40e-4aed-bcb8-ffc87b398289 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:21 devstack sudo[104735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501 Sep 21 12:10:21 devstack sudo[104735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b9bc46cf-2500-4601-9197-b479dcda6de2 tempest-VolumeDependencyTests-1245787338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:22 devstack sudo[104735]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-34b77789-f40e-4aed-bcb8-ffc87b398289 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501" returned: 0 in 0.533s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-34b77789-f40e-4aed-bcb8-ffc87b398289 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501.590d3003-1d02-488e-a253-dbc86f36b063 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:22 devstack sudo[104740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501.590d3003-1d02-488e-a253-dbc86f36b063 1G Sep 21 12:10:22 devstack sudo[104740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:22 devstack sudo[104740]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-34b77789-f40e-4aed-bcb8-ffc87b398289 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501.590d3003-1d02-488e-a253-dbc86f36b063 1G" returned: 0 in 0.571s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-34b77789-f40e-4aed-bcb8-ffc87b398289 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0a7d833-a65a-497b-8aff-133d901f0501 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501.590d3003-1d02-488e-a253-dbc86f36b063 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:22 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0a7d833-a65a-497b-8aff-133d901f0501 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501.590d3003-1d02-488e-a253-dbc86f36b063 Sep 21 12:10:22 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:23 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-34b77789-f40e-4aed-bcb8-ffc87b398289 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0a7d833-a65a-497b-8aff-133d901f0501 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501.590d3003-1d02-488e-a253-dbc86f36b063" returned: 0 in 0.392s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:23 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-34b77789-f40e-4aed-bcb8-ffc87b398289 tempest-CreateVolumesFromSnapshotTest-1973825980 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501.590d3003-1d02-488e-a253-dbc86f36b063 is being set with open permissions: ugo+rw Sep 21 12:10:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-34b77789-f40e-4aed-bcb8-ffc87b398289 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501.590d3003-1d02-488e-a253-dbc86f36b063 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:23 devstack sudo[104752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501.590d3003-1d02-488e-a253-dbc86f36b063 Sep 21 12:10:23 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:23 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-34b77789-f40e-4aed-bcb8-ffc87b398289 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501.590d3003-1d02-488e-a253-dbc86f36b063" returned: 0 in 0.316s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-34b77789-f40e-4aed-bcb8-ffc87b398289 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:23 devstack sudo[104755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501.info Sep 21 12:10:23 devstack sudo[104755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:23 devstack sudo[104755]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-34b77789-f40e-4aed-bcb8-ffc87b398289 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501.info" returned: 0 in 0.312s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:23 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-34b77789-f40e-4aed-bcb8-ffc87b398289 tempest-CreateVolumesFromSnapshotTest-1973825980 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501.info is being set with open permissions: ugo+rw Sep 21 12:10:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-34b77789-f40e-4aed-bcb8-ffc87b398289 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:23 devstack sudo[104758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501.info Sep 21 12:10:23 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:24 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:10:24 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Flow 'volume_create_manager' (ea11335e-356e-45bc-9db5-aa83cba36486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144ec7ac-442d-493f-9dcf-100e0d4f0c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-34b77789-f40e-4aed-bcb8-ffc87b398289 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501.info" returned: 0 in 0.328s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-34b77789-f40e-4aed-bcb8-ffc87b398289 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.589s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b9bc46cf-2500-4601-9197-b479dcda6de2 tempest-VolumeDependencyTests-1245787338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.253s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144ec7ac-442d-493f-9dcf-100e0d4f0c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f0b4c53-f739-4fae-83b8-9536a8c53fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2165147c2640abab1920a946911c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:24Z,use_quota=True,user_id='654d58dce70c46d49eeec53503ea0327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdb52e5a-9ebe-44a3-a13d-345ed58babee),volume_type_id=cdb52e5a-9ebe-44a3-a13d-345ed58babee)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08bccec5-a156-4ecc-aa80-d6fbd957ede3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08bccec5-a156-4ecc-aa80-d6fbd957ede3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:24 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af0f8b11-a757-4bf7-9154-38c4eaf979e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:24 devstack cinder-volume[86366]: DEBUG cinder.image.glance [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Creating Keystone auth plugin from conf {{(pid=86366) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 21 12:10:24 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-b9bc46cf-2500-4601-9197-b479dcda6de2 tempest-VolumeDependencyTests-1245787338 None] Creating offline snapshot 4e725358-e0d6-4ad9-9690-0966e2d45bc5 of volume 0ea0548a-1d73-4f9c-badd-61dce6a2e0b0 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:10:24 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-34b77789-f40e-4aed-bcb8-ffc87b398289 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Create snapshot completed successfully Sep 21 12:10:24 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d44be18-bef9-43f2-990f-594f595300ce]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:10:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b9bc46cf-2500-4601-9197-b479dcda6de2 tempest-VolumeDependencyTests-1245787338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:24 devstack sudo[104761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0 Sep 21 12:10:24 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:24 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b9bc46cf-2500-4601-9197-b479dcda6de2 tempest-VolumeDependencyTests-1245787338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0" returned: 0 in 0.543s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b9bc46cf-2500-4601-9197-b479dcda6de2 tempest-VolumeDependencyTests-1245787338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.4e725358-e0d6-4ad9-9690-0966e2d45bc5 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:24 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.4e725358-e0d6-4ad9-9690-0966e2d45bc5 1G Sep 21 12:10:24 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af0f8b11-a757-4bf7-9154-38c4eaf979e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4f0b4c53-f739-4fae-83b8-9536a8c53fc4', 'volume_name': 'volume-4f0b4c53-f739-4fae-83b8-9536a8c53fc4', 'volume_size': 1, 'image_id': '075c5cb5-76f4-465e-af89-38620b0bb10b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/075c5cb5-76f4-465e-af89-38620b0bb10b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c15bbb932e281839d14f6a612b05e840', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e2165147c2640abab1920a946911c8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '42db254a8b79a185050f5ad6109f7d68b8da62d058138ca0dbf716e8164d6b42de28150b397f172478ba0e901904dac0e567cb1dea5a46b6c1b403fc3b191f04', 'id': '075c5cb5-76f4-465e-af89-38620b0bb10b', 'created_at': datetime.datetime(2026, 9, 21, 10, 10, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 10, 10, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/075c5cb5-76f4-465e-af89-38620b0bb10b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd40dffa-0ea1-439d-8f12-d8b0feb56641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd40dffa-0ea1-439d-8f12-d8b0feb56641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a4e3f3-a1d9-43f4-940b-5afb7788959c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:25 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Volume 4f0b4c53-f739-4fae-83b8-9536a8c53fc4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4f0b4c53-f739-4fae-83b8-9536a8c53fc4', 'volume_size': 1, 'image_id': '075c5cb5-76f4-465e-af89-38620b0bb10b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/075c5cb5-76f4-465e-af89-38620b0bb10b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c15bbb932e281839d14f6a612b05e840', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e2165147c2640abab1920a946911c8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '42db254a8b79a185050f5ad6109f7d68b8da62d058138ca0dbf716e8164d6b42de28150b397f172478ba0e901904dac0e567cb1dea5a46b6c1b403fc3b191f04', 'id': '075c5cb5-76f4-465e-af89-38620b0bb10b', 'created_at': datetime.datetime(2026, 9, 21, 10, 10, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 10, 10, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/075c5cb5-76f4-465e-af89-38620b0bb10b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 21 12:10:25 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Trying to clone 4f0b4c53-f739-4fae-83b8-9536a8c53fc4 from image 075c5cb5-76f4-465e-af89-38620b0bb10b at location (None, [{'url': 'file:///opt/stack/data/glance/images/075c5cb5-76f4-465e-af89-38620b0bb10b', 'metadata': {}}]). {{(pid=86366) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 21 12:10:25 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:10:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Flow 'volume_create_manager' (a1651155-019e-4b18-851b-9946307a92cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0624aaf5-5b7e-4143-a810-7902e84a3a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:25 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_075c5cb5-76f4-465e-af89-38620b0bb10b_sgzy0m9sdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 21 12:10:25 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Image download 0.00 MB at 0.00 MB/s Sep 21 12:10:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0624aaf5-5b7e-4143-a810-7902e84a3a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2047140762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3546e49-eb7f-49db-a720-087bbe03c246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a4a5d58f0ab408cb65c441a42a45ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:25Z,use_quota=True,user_id='72fd573c46d04ca1a268ad1ef2b41ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3c8538-8e09-426b-9283-3e99bc867655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3c8538-8e09-426b-9283-3e99bc867655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (218fa872-59a6-4658-8c40-89b06c0f6187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (218fa872-59a6-4658-8c40-89b06c0f6187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3546e49-eb7f-49db-a720-087bbe03c246', 'volume_name': 'volume-f3546e49-eb7f-49db-a720-087bbe03c246', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05db4677-f2b9-4482-bb3d-7b3f47d91861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05db4677-f2b9-4482-bb3d-7b3f47d91861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f4c004-efca-4018-94c2-96a8e7faa0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:25 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Volume f3546e49-eb7f-49db-a720-087bbe03c246: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3546e49-eb7f-49db-a720-087bbe03c246', 'volume_size': 1} Sep 21 12:10:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:25 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbc762f-67bf-41a2-844a-a5b512842501]: (4, 'raw') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:10:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_075c5cb5-76f4-465e-af89-38620b0bb10b_sgzy0m9sdevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:25 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b9bc46cf-2500-4601-9197-b479dcda6de2 tempest-VolumeDependencyTests-1245787338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.4e725358-e0d6-4ad9-9690-0966e2d45bc5 1G" returned: 0 in 0.784s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b9bc46cf-2500-4601-9197-b479dcda6de2 tempest-VolumeDependencyTests-1245787338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.4e725358-e0d6-4ad9-9690-0966e2d45bc5 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:25 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.4e725358-e0d6-4ad9-9690-0966e2d45bc5 Sep 21 12:10:25 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:25 devstack sudo[104772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_075c5cb5-76f4-465e-af89-38620b0bb10b_sgzy0m9sdevstack@QuobyteHD Sep 21 12:10:25 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Flow 'volume_create_manager' (39889a5d-1c79-4c57-886c-fb0ae7d238a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8f851b-4ffb-4303-b64c-df48ef329d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8f851b-4ffb-4303-b64c-df48ef329d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-727505561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1defe58c-22de-4fb9-a6c2-d40620e1a532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a4a5d58f0ab408cb65c441a42a45ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:26Z,use_quota=True,user_id='72fd573c46d04ca1a268ad1ef2b41ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c0d084-cc4a-4088-80ac-2274b9b470c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40c0d084-cc4a-4088-80ac-2274b9b470c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dd3b780-39ee-47b1-a414-d8b8eba19c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dd3b780-39ee-47b1-a414-d8b8eba19c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1defe58c-22de-4fb9-a6c2-d40620e1a532', 'volume_name': 'volume-1defe58c-22de-4fb9-a6c2-d40620e1a532', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2efaf519-a8e7-42e6-94ee-3f4eb7dccd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2efaf519-a8e7-42e6-94ee-3f4eb7dccd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d018af0-97c0-4bdb-b9e6-cfa7faeb4105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:26 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Volume 1defe58c-22de-4fb9-a6c2-d40620e1a532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1defe58c-22de-4fb9-a6c2-d40620e1a532', 'volume_size': 1} Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:26 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b9bc46cf-2500-4601-9197-b479dcda6de2 tempest-VolumeDependencyTests-1245787338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.4e725358-e0d6-4ad9-9690-0966e2d45bc5" returned: 0 in 0.574s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:26 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-b9bc46cf-2500-4601-9197-b479dcda6de2 tempest-VolumeDependencyTests-1245787338 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.4e725358-e0d6-4ad9-9690-0966e2d45bc5 is being set with open permissions: ugo+rw Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b9bc46cf-2500-4601-9197-b479dcda6de2 tempest-VolumeDependencyTests-1245787338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.4e725358-e0d6-4ad9-9690-0966e2d45bc5 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:26 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_075c5cb5-76f4-465e-af89-38620b0bb10b_sgzy0m9sdevstack@QuobyteHD" returned: 0 in 0.666s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_075c5cb5-76f4-465e-af89-38620b0bb10b_sgzy0m9sdevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:26 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.4e725358-e0d6-4ad9-9690-0966e2d45bc5 Sep 21 12:10:26 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:26 devstack sudo[104783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_075c5cb5-76f4-465e-af89-38620b0bb10b_sgzy0m9sdevstack@QuobyteHD Sep 21 12:10:26 devstack sudo[104783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:26 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b9bc46cf-2500-4601-9197-b479dcda6de2 tempest-VolumeDependencyTests-1245787338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.4e725358-e0d6-4ad9-9690-0966e2d45bc5" returned: 0 in 0.372s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b9bc46cf-2500-4601-9197-b479dcda6de2 tempest-VolumeDependencyTests-1245787338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:26 devstack sudo[104783]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_075c5cb5-76f4-465e-af89-38620b0bb10b_sgzy0m9sdevstack@QuobyteHD" returned: 1 in 0.448s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:26 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.info Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_075c5cb5-76f4-465e-af89-38620b0bb10b_sgzy0m9sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Temporary image 075c5cb5-76f4-465e-af89-38620b0bb10b is fetched for user 654d58dce70c46d49eeec53503ea0327. {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 21 12:10:26 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Flow 'volume_create_manager' (a2706f10-b49d-44a6-a604-320572f71025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c89fcc-ad7a-4c40-a2fd-bd3b07018c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74c89fcc-ad7a-4c40-a2fd-bd3b07018c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-774182447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9a82855-a1c8-40af-9052-9b6493cf157c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a4a5d58f0ab408cb65c441a42a45ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:27Z,use_quota=True,user_id='72fd573c46d04ca1a268ad1ef2b41ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f23df941-d39d-4c12-93a7-154a0854af20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f23df941-d39d-4c12-93a7-154a0854af20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e99410-ed95-4a0e-b3f6-e19bfb15a927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4e99410-ed95-4a0e-b3f6-e19bfb15a927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9a82855-a1c8-40af-9052-9b6493cf157c', 'volume_name': 'volume-c9a82855-a1c8-40af-9052-9b6493cf157c', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c30b28fe-de7d-44fb-a601-7a7687c00d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c30b28fe-de7d-44fb-a601-7a7687c00d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (698fe9a2-15e5-4406-9ac7-56ff24adb322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:26 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Volume c9a82855-a1c8-40af-9052-9b6493cf157c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9a82855-a1c8-40af-9052-9b6493cf157c', 'volume_size': 1} Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20c3157-c199-483a-b533-63db0985f511]: (4, 'raw') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:10:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_075c5cb5-76f4-465e-af89-38620b0bb10b_sgzy0m9sdevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Flow 'volume_create_manager' (c3747bb0-e73d-4a4e-810d-bb1ad0f3fcb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243d903f-467c-4c31-881e-b168b75e81e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (243d903f-467c-4c31-881e-b168b75e81e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-95919627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437c373d-e9e4-4402-b37a-5797e377f988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a4a5d58f0ab408cb65c441a42a45ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:27Z,use_quota=True,user_id='72fd573c46d04ca1a268ad1ef2b41ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:27 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b88570-83c5-40e9-9151-9b1d8b0c6901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b88570-83c5-40e9-9151-9b1d8b0c6901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c3eb506-eb39-4126-b7f1-57e86e1856ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c3eb506-eb39-4126-b7f1-57e86e1856ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '437c373d-e9e4-4402-b37a-5797e377f988', 'volume_name': 'volume-437c373d-e9e4-4402-b37a-5797e377f988', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d489cf7-445d-4e35-a81e-90ba553de043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d489cf7-445d-4e35-a81e-90ba553de043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (addb91ae-86fc-4dab-9287-eb4fd4eab947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:27 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Volume 437c373d-e9e4-4402-b37a-5797e377f988: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-437c373d-e9e4-4402-b37a-5797e377f988', 'volume_size': 1} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b9bc46cf-2500-4601-9197-b479dcda6de2 tempest-VolumeDependencyTests-1245787338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.info" returned: 0 in 0.444s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:27 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-b9bc46cf-2500-4601-9197-b479dcda6de2 tempest-VolumeDependencyTests-1245787338 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.info is being set with open permissions: ugo+rw Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b9bc46cf-2500-4601-9197-b479dcda6de2 tempest-VolumeDependencyTests-1245787338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:27 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_075c5cb5-76f4-465e-af89-38620b0bb10b_sgzy0m9sdevstack@QuobyteHD Sep 21 12:10:27 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:27 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.info Sep 21 12:10:27 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Flow 'volume_create_manager' (51fc4433-6648-4857-be94-9174457d7bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (735d7b5b-6d06-40e4-aa07-2143776f219f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:27 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (735d7b5b-6d06-40e4-aa07-2143776f219f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2092125161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c53d9d2-2cee-4f48-81c5-a3a2382810ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a4a5d58f0ab408cb65c441a42a45ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:27Z,use_quota=True,user_id='72fd573c46d04ca1a268ad1ef2b41ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3e4b95-ff92-49fb-9013-fc9fe4255656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3e4b95-ff92-49fb-9013-fc9fe4255656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e701a3d2-d309-40c2-843c-7cebecdbebab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e701a3d2-d309-40c2-843c-7cebecdbebab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c53d9d2-2cee-4f48-81c5-a3a2382810ae', 'volume_name': 'volume-9c53d9d2-2cee-4f48-81c5-a3a2382810ae', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8c4ea23-0039-499a-9eb3-a498f67c74c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8c4ea23-0039-499a-9eb3-a498f67c74c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e67144e2-d36f-4177-a284-a0926ac7ed39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:27 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Volume 9c53d9d2-2cee-4f48-81c5-a3a2382810ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c53d9d2-2cee-4f48-81c5-a3a2382810ae', 'volume_size': 1} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_075c5cb5-76f4-465e-af89-38620b0bb10b_sgzy0m9sdevstack@QuobyteHD" returned: 0 in 0.576s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_075c5cb5-76f4-465e-af89-38620b0bb10b_sgzy0m9sdevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:27 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b9bc46cf-2500-4601-9197-b479dcda6de2 tempest-VolumeDependencyTests-1245787338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.info" returned: 0 in 0.369s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b9bc46cf-2500-4601-9197-b479dcda6de2 tempest-VolumeDependencyTests-1245787338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.251s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.942s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2047140762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3546e49-eb7f-49db-a720-087bbe03c246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a4a5d58f0ab408cb65c441a42a45ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:25Z,use_quota=True,user_id='72fd573c46d04ca1a268ad1ef2b41ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Creating volume f3546e49-eb7f-49db-a720-087bbe03c246 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:10:27 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f3546e49-eb7f-49db-a720-087bbe03c246 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:27 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f3546e49-eb7f-49db-a720-087bbe03c246 1073741824 Sep 21 12:10:27 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:27 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-b9bc46cf-2500-4601-9197-b479dcda6de2 tempest-VolumeDependencyTests-1245787338 None] Create snapshot completed successfully Sep 21 12:10:27 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_075c5cb5-76f4-465e-af89-38620b0bb10b_sgzy0m9sdevstack@QuobyteHD Sep 21 12:10:27 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:27 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_075c5cb5-76f4-465e-af89-38620b0bb10b_sgzy0m9sdevstack@QuobyteHD" returned: 1 in 0.450s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_075c5cb5-76f4-465e-af89-38620b0bb10b_sgzy0m9sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 12:10:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:28 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f3546e49-eb7f-49db-a720-087bbe03c246 1073741824" returned: 0 in 0.527s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f3546e49-eb7f-49db-a720-087bbe03c246 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:28 devstack sudo[104811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f3546e49-eb7f-49db-a720-087bbe03c246 Sep 21 12:10:28 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:28 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f3546e49-eb7f-49db-a720-087bbe03c246" returned: 0 in 0.313s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:28 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:10:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.254s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:28 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-727505561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1defe58c-22de-4fb9-a6c2-d40620e1a532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a4a5d58f0ab408cb65c441a42a45ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:26Z,use_quota=True,user_id='72fd573c46d04ca1a268ad1ef2b41ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:10:28 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Creating volume 1defe58c-22de-4fb9-a6c2-d40620e1a532 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:10:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:28 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:28 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:28 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:10:28 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:10:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1defe58c-22de-4fb9-a6c2-d40620e1a532 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f4c004-efca-4018-94c2-96a8e7faa0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3546e49-eb7f-49db-a720-087bbe03c246', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bed4b5f-3385-4a59-870b-2cb3aae9d2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:28 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1defe58c-22de-4fb9-a6c2-d40620e1a532 1073741824 Sep 21 12:10:28 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:28 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Volume volume-f3546e49-eb7f-49db-a720-087bbe03c246 (f3546e49-eb7f-49db-a720-087bbe03c246): created successfully Sep 21 12:10:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bed4b5f-3385-4a59-870b-2cb3aae9d2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Flow 'volume_create_manager' (a1651155-019e-4b18-851b-9946307a92cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:28 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-5ebea674-212e-4f37-82d1-ef3c16832058 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Created volume successfully. Sep 21 12:10:28 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1defe58c-22de-4fb9-a6c2-d40620e1a532 1073741824" returned: 0 in 0.528s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1defe58c-22de-4fb9-a6c2-d40620e1a532 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:29 devstack sudo[104822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1defe58c-22de-4fb9-a6c2-d40620e1a532 Sep 21 12:10:29 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Flow 'volume_create_manager' (cf658151-e155-42f5-a595-282b0bd7353b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368c03ab-55fe-44c7-b016-ea21659399ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368c03ab-55fe-44c7-b016-ea21659399ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1834504409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c80f58fa-97ae-4061-8e8b-80c491a605aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc0b76caf05940bc91b32f4dc6a48cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4e725358-e0d6-4ad9-9690-0966e2d45bc5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:29Z,use_quota=True,user_id='8f5ff040483349a0aa9e555fd0a4614a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed3c6f57-177d-4c80-90ad-3b4d8a6e808f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed3c6f57-177d-4c80-90ad-3b4d8a6e808f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567cb5da-ef72-4725-8cf1-e5c37515c829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567cb5da-ef72-4725-8cf1-e5c37515c829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c80f58fa-97ae-4061-8e8b-80c491a605aa', 'volume_name': 'volume-c80f58fa-97ae-4061-8e8b-80c491a605aa', 'volume_size': 1, 'snapshot_id': '4e725358-e0d6-4ad9-9690-0966e2d45bc5'}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92137b8-a9ce-42e3-8554-88f5930cf30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92137b8-a9ce-42e3-8554-88f5930cf30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12e7790-00fd-4c76-939f-ea9e9b2ff012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:29 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Volume c80f58fa-97ae-4061-8e8b-80c491a605aa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c80f58fa-97ae-4061-8e8b-80c491a605aa', 'volume_size': 1, 'snapshot_id': '4e725358-e0d6-4ad9-9690-0966e2d45bc5'} Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:29 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1defe58c-22de-4fb9-a6c2-d40620e1a532" returned: 0 in 0.254s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.420s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-774182447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9a82855-a1c8-40af-9052-9b6493cf157c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a4a5d58f0ab408cb65c441a42a45ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:27Z,use_quota=True,user_id='72fd573c46d04ca1a268ad1ef2b41ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Creating volume c9a82855-a1c8-40af-9052-9b6493cf157c {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:10:29 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c9a82855-a1c8-40af-9052-9b6493cf157c 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d018af0-97c0-4bdb-b9e6-cfa7faeb4105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1defe58c-22de-4fb9-a6c2-d40620e1a532', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf144ea3-ff2d-45d2-ad2a-951f263f8d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:29 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c9a82855-a1c8-40af-9052-9b6493cf157c 1073741824 Sep 21 12:10:29 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:29 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Volume volume-1defe58c-22de-4fb9-a6c2-d40620e1a532 (1defe58c-22de-4fb9-a6c2-d40620e1a532): created successfully Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf144ea3-ff2d-45d2-ad2a-951f263f8d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Flow 'volume_create_manager' (39889a5d-1c79-4c57-886c-fb0ae7d238a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:29 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-62348314-d2e3-4678-8e48-10d691aa79a4 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Created volume successfully. Sep 21 12:10:29 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c9a82855-a1c8-40af-9052-9b6493cf157c 1073741824" returned: 0 in 0.550s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c9a82855-a1c8-40af-9052-9b6493cf157c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:29 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c9a82855-a1c8-40af-9052-9b6493cf157c Sep 21 12:10:29 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:30 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c9a82855-a1c8-40af-9052-9b6493cf157c" returned: 0 in 0.291s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.039s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-95919627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437c373d-e9e4-4402-b37a-5797e377f988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a4a5d58f0ab408cb65c441a42a45ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:27Z,use_quota=True,user_id='72fd573c46d04ca1a268ad1ef2b41ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Creating volume 437c373d-e9e4-4402-b37a-5797e377f988 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:10:30 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-437c373d-e9e4-4402-b37a-5797e377f988 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (698fe9a2-15e5-4406-9ac7-56ff24adb322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9a82855-a1c8-40af-9052-9b6493cf157c', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:30 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-437c373d-e9e4-4402-b37a-5797e377f988 1073741824 Sep 21 12:10:30 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc6e161-3851-4bd2-b510-752dfb5d1185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:30 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Volume volume-c9a82855-a1c8-40af-9052-9b6493cf157c (c9a82855-a1c8-40af-9052-9b6493cf157c): created successfully Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc6e161-3851-4bd2-b510-752dfb5d1185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Flow 'volume_create_manager' (a2706f10-b49d-44a6-a604-320572f71025) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:30 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-053df26c-f5d6-40e1-af27-f83be54baa0b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Created volume successfully. Sep 21 12:10:30 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-437c373d-e9e4-4402-b37a-5797e377f988 1073741824" returned: 0 in 0.478s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-437c373d-e9e4-4402-b37a-5797e377f988 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:30 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-437c373d-e9e4-4402-b37a-5797e377f988 Sep 21 12:10:30 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:30 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-437c373d-e9e4-4402-b37a-5797e377f988" returned: 0 in 0.243s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.466s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2092125161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c53d9d2-2cee-4f48-81c5-a3a2382810ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a4a5d58f0ab408cb65c441a42a45ea2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:27Z,use_quota=True,user_id='72fd573c46d04ca1a268ad1ef2b41ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Creating volume 9c53d9d2-2cee-4f48-81c5-a3a2382810ae {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:10:30 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9c53d9d2-2cee-4f48-81c5-a3a2382810ae 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (addb91ae-86fc-4dab-9287-eb4fd4eab947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-437c373d-e9e4-4402-b37a-5797e377f988', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:30 devstack sudo[104844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9c53d9d2-2cee-4f48-81c5-a3a2382810ae 1073741824 Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a01f643-05c8-4507-a658-2509693e82f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:30 devstack sudo[104844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:30 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Volume volume-437c373d-e9e4-4402-b37a-5797e377f988 (437c373d-e9e4-4402-b37a-5797e377f988): created successfully Sep 21 12:10:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a01f643-05c8-4507-a658-2509693e82f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Flow 'volume_create_manager' (c3747bb0-e73d-4a4e-810d-bb1ad0f3fcb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:31 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-bd8f04bd-41ca-4110-a42b-4eca2bd5e291 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Created volume successfully. Sep 21 12:10:31 devstack sudo[104844]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9c53d9d2-2cee-4f48-81c5-a3a2382810ae 1073741824" returned: 0 in 0.473s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9c53d9d2-2cee-4f48-81c5-a3a2382810ae {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:31 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9c53d9d2-2cee-4f48-81c5-a3a2382810ae Sep 21 12:10:31 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:31 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9c53d9d2-2cee-4f48-81c5-a3a2382810ae" returned: 0 in 0.294s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:10:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.847s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f0b4c53-f739-4fae-83b8-9536a8c53fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e2165147c2640abab1920a946911c8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:24Z,use_quota=True,user_id='654d58dce70c46d49eeec53503ea0327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdb52e5a-9ebe-44a3-a13d-345ed58babee),volume_type_id=cdb52e5a-9ebe-44a3-a13d-345ed58babee)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:10:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Creating volume 4f0b4c53-f739-4fae-83b8-9536a8c53fc4 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:10:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:10:31 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:10:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f0b4c53-f739-4fae-83b8-9536a8c53fc4 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e67144e2-d36f-4177-a284-a0926ac7ed39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c53d9d2-2cee-4f48-81c5-a3a2382810ae', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:31 devstack sudo[104853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f0b4c53-f739-4fae-83b8-9536a8c53fc4 1073741824 Sep 21 12:10:31 devstack sudo[104853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c9ba98-5df7-4e4d-b1cf-7cb4bf06afb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:31 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Volume volume-9c53d9d2-2cee-4f48-81c5-a3a2382810ae (9c53d9d2-2cee-4f48-81c5-a3a2382810ae): created successfully Sep 21 12:10:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c9ba98-5df7-4e4d-b1cf-7cb4bf06afb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Flow 'volume_create_manager' (51fc4433-6648-4857-be94-9174457d7bef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:31 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-fd334235-7df2-4950-8907-13c9a2c9d53c tempest-CreateVolumesFromSnapshotTest-1973825980 None] Created volume successfully. Sep 21 12:10:32 devstack sudo[104853]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f0b4c53-f739-4fae-83b8-9536a8c53fc4 1073741824" returned: 0 in 0.509s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f0b4c53-f739-4fae-83b8-9536a8c53fc4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:32 devstack sudo[104859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f0b4c53-f739-4fae-83b8-9536a8c53fc4 Sep 21 12:10:32 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:32 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f0b4c53-f739-4fae-83b8-9536a8c53fc4" returned: 0 in 0.303s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.482s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Acquiring lock "cinder-quobyte-4e725358-e0d6-4ad9-9690-0966e2d45bc5-c80f58fa-97ae-4061-8e8b-80c491a605aa" by "_create_volume_from_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Lock "cinder-quobyte-4e725358-e0d6-4ad9-9690-0966e2d45bc5-c80f58fa-97ae-4061-8e8b-80c491a605aa" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Creating volume c80f58fa-97ae-4061-8e8b-80c491a605aa from snapshot 4e725358-e0d6-4ad9-9690-0966e2d45bc5 {{(pid=86366) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Acquiring lock "cinder-quobyte-c80f58fa-97ae-4061-8e8b-80c491a605aa" by "_copy_volume_from_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Attempting download of 075c5cb5-76f4-465e-af89-38620b0bb10b ((None, [{'url': 'file:///opt/stack/data/glance/images/075c5cb5-76f4-465e-af89-38620b0bb10b', 'metadata': {}}])) to volume 4f0b4c53-f739-4fae-83b8-9536a8c53fc4. {{(pid=86366) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Lock "cinder-quobyte-c80f58fa-97ae-4061-8e8b-80c491a605aa" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] snapshot: 4e725358-e0d6-4ad9-9690-0966e2d45bc5, volume: c80f58fa-97ae-4061-8e8b-80c491a605aa, {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8c847a-e65d-49b9-9198-b8be33efe257]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.4e725358-e0d6-4ad9-9690-0966e2d45bc5 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef479c51-6698-4e6d-9019-aa41582925ca]: (4, 'raw') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_075c5cb5-76f4-465e-af89-38620b0bb10b_ib1y11sj {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-04734d96-6f75-4a14-8876-86981049c230 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "cinder-9c53d9d2-2cee-4f48-81c5-a3a2382810ae-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:32 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-04734d96-6f75-4a14-8876-86981049c230 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-9c53d9d2-2cee-4f48-81c5-a3a2382810ae-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:32 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_075c5cb5-76f4-465e-af89-38620b0bb10b_ib1y11sj Sep 21 12:10:32 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:33 devstack sudo[104862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.4e725358-e0d6-4ad9-9690-0966e2d45bc5 Sep 21 12:10:33 devstack sudo[104862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-04734d96-6f75-4a14-8876-86981049c230 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "cinder-quobyte-9c53d9d2-2cee-4f48-81c5-a3a2382810ae" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-04734d96-6f75-4a14-8876-86981049c230 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-quobyte-9c53d9d2-2cee-4f48-81c5-a3a2382810ae" acquired by "delete_volume" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:33 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0952260-7e4d-4ac0-82ef-feedd9cb6324]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:10:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-04734d96-6f75-4a14-8876-86981049c230 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9c53d9d2-2cee-4f48-81c5-a3a2382810ae {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:33 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9c53d9d2-2cee-4f48-81c5-a3a2382810ae Sep 21 12:10:33 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:33 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_075c5cb5-76f4-465e-af89-38620b0bb10b_ib1y11sj" returned: 0 in 0.475s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_075c5cb5-76f4-465e-af89-38620b0bb10b_ib1y11sj {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:33 devstack sudo[104862]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.4e725358-e0d6-4ad9-9690-0966e2d45bc5" returned: 0 in 0.605s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:10:33 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94e3363-4af1-42eb-9e83-3404c0d7973d]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:10:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:33 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_075c5cb5-76f4-465e-af89-38620b0bb10b_ib1y11sj Sep 21 12:10:33 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:33 devstack sudo[104874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0 Sep 21 12:10:33 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:33 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-04734d96-6f75-4a14-8876-86981049c230 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9c53d9d2-2cee-4f48-81c5-a3a2382810ae" returned: 0 in 0.495s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-04734d96-6f75-4a14-8876-86981049c230 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9c53d9d2-2cee-4f48-81c5-a3a2382810ae {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:33 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9c53d9d2-2cee-4f48-81c5-a3a2382810ae Sep 21 12:10:33 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:33 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_075c5cb5-76f4-465e-af89-38620b0bb10b_ib1y11sj" returned: 1 in 0.471s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_075c5cb5-76f4-465e-af89-38620b0bb10b_ib1y11sj' failed. Not Retrying. {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 12:10:33 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[189c8d18-291b-4417-b685-b43baec87ed2]: (4, 'raw') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:10:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_075c5cb5-76f4-465e-af89-38620b0bb10b_sgzy0m9sdevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:33 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_075c5cb5-76f4-465e-af89-38620b0bb10b_sgzy0m9sdevstack@QuobyteHD Sep 21 12:10:33 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:33 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0" returned: 0 in 0.506s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0 {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 21 12:10:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Creating direct copy from snapshot {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 21 12:10:33 devstack cinder-volume[86366]: DEBUG cinder.utils [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Path /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c80f58fa-97ae-4061-8e8b-80c491a605aa not found in is_blk_device check {{(pid=86366) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 21 12:10:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c80f58fa-97ae-4061-8e8b-80c491a605aa {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:33 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-04734d96-6f75-4a14-8876-86981049c230 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9c53d9d2-2cee-4f48-81c5-a3a2382810ae" returned: 0 in 0.348s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:33 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c80f58fa-97ae-4061-8e8b-80c491a605aa Sep 21 12:10:33 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:34 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-04734d96-6f75-4a14-8876-86981049c230 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-quobyte-9c53d9d2-2cee-4f48-81c5-a3a2382810ae" released by "delete_volume" :: held 0.917s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:34 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-04734d96-6f75-4a14-8876-86981049c230 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Created reservations ['7adcfd8d-7c7c-413d-a887-a9eab4708636', '2f7baa7c-62f4-4bae-a4cf-4771fdcbfc36', 'c57197dd-5229-4ce7-8d37-55fadca51171', 'c7246b6b-dd78-4228-b6db-f4d7117fe474'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:10:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-04734d96-6f75-4a14-8876-86981049c230 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-04734d96-6f75-4a14-8876-86981049c230 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:34 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-04734d96-6f75-4a14-8876-86981049c230 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:34 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-04734d96-6f75-4a14-8876-86981049c230 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-04734d96-6f75-4a14-8876-86981049c230 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-04734d96-6f75-4a14-8876-86981049c230 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:34 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:10:34 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:34 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_075c5cb5-76f4-465e-af89-38620b0bb10b_sgzy0m9sdevstack@QuobyteHD" returned: 0 in 0.461s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_075c5cb5-76f4-465e-af89-38620b0bb10b_sgzy0m9sdevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:34 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_075c5cb5-76f4-465e-af89-38620b0bb10b_sgzy0m9sdevstack@QuobyteHD Sep 21 12:10:34 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:34 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-04734d96-6f75-4a14-8876-86981049c230 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.350s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:34 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-04734d96-6f75-4a14-8876-86981049c230 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:10:34 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-04734d96-6f75-4a14-8876-86981049c230 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Deleted volume successfully. Sep 21 12:10:34 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-04734d96-6f75-4a14-8876-86981049c230 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-9c53d9d2-2cee-4f48-81c5-a3a2382810ae-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:34 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_075c5cb5-76f4-465e-af89-38620b0bb10b_sgzy0m9sdevstack@QuobyteHD" returned: 1 in 0.475s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_075c5cb5-76f4-465e-af89-38620b0bb10b_sgzy0m9sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 12:10:34 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] 075c5cb5-76f4-465e-af89-38620b0bb10b was raw, converting to qcow2 {{(pid=86366) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 21 12:10:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_075c5cb5-76f4-465e-af89-38620b0bb10b_sgzy0m9sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f0b4c53-f739-4fae-83b8-9536a8c53fc4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:34 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_075c5cb5-76f4-465e-af89-38620b0bb10b_sgzy0m9sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f0b4c53-f739-4fae-83b8-9536a8c53fc4 Sep 21 12:10:34 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:35 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9011a798-c151-4523-a474-9672d7376452 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "cinder-437c373d-e9e4-4402-b37a-5797e377f988-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:35 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9011a798-c151-4523-a474-9672d7376452 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-437c373d-e9e4-4402-b37a-5797e377f988-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:35 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9011a798-c151-4523-a474-9672d7376452 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "cinder-quobyte-437c373d-e9e4-4402-b37a-5797e377f988" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:35 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9011a798-c151-4523-a474-9672d7376452 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-quobyte-437c373d-e9e4-4402-b37a-5797e377f988" acquired by "delete_volume" :: waited 0.034s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:35 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[134ed1d2-a6c7-4960-b9fd-11e7e37d76cd]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:10:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9011a798-c151-4523-a474-9672d7376452 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-437c373d-e9e4-4402-b37a-5797e377f988 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:35 devstack sudo[104920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-437c373d-e9e4-4402-b37a-5797e377f988 Sep 21 12:10:35 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:36 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_075c5cb5-76f4-465e-af89-38620b0bb10b_sgzy0m9sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f0b4c53-f739-4fae-83b8-9536a8c53fc4" returned: 0 in 1.367s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:36 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_075c5cb5-76f4-465e-af89-38620b0bb10b_sgzy0m9sdevstack@QuobyteHD, size 0.00 MB, duration 1.37 sec, destination /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f0b4c53-f739-4fae-83b8-9536a8c53fc4 {{(pid=86366) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 12:10:36 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Converted 0.00 MB image at 0.00 MB/s Sep 21 12:10:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f0b4c53-f739-4fae-83b8-9536a8c53fc4 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:36 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f0b4c53-f739-4fae-83b8-9536a8c53fc4 1G Sep 21 12:10:36 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:36 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9011a798-c151-4523-a474-9672d7376452 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-437c373d-e9e4-4402-b37a-5797e377f988" returned: 0 in 0.750s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9011a798-c151-4523-a474-9672d7376452 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-437c373d-e9e4-4402-b37a-5797e377f988 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:36 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-437c373d-e9e4-4402-b37a-5797e377f988 Sep 21 12:10:36 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:36 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f0b4c53-f739-4fae-83b8-9536a8c53fc4 1G" returned: 0 in 0.759s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:36 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Downloaded image 075c5cb5-76f4-465e-af89-38620b0bb10b ((None, [{'url': 'file:///opt/stack/data/glance/images/075c5cb5-76f4-465e-af89-38620b0bb10b', 'metadata': {}}])) to volume 4f0b4c53-f739-4fae-83b8-9536a8c53fc4 successfully. {{(pid=86366) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 21 12:10:36 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Temporary image 075c5cb5-76f4-465e-af89-38620b0bb10b for user 654d58dce70c46d49eeec53503ea0327 is deleted. {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 21 12:10:36 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Marking volume 4f0b4c53-f739-4fae-83b8-9536a8c53fc4 as bootable. {{(pid=86366) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 21 12:10:36 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Copying metadata from image 075c5cb5-76f4-465e-af89-38620b0bb10b to 4f0b4c53-f739-4fae-83b8-9536a8c53fc4. {{(pid=86366) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 21 12:10:36 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Creating volume glance metadata for volume 4f0b4c53-f739-4fae-83b8-9536a8c53fc4 backed by image 075c5cb5-76f4-465e-af89-38620b0bb10b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '075c5cb5-76f4-465e-af89-38620b0bb10b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c15bbb932e281839d14f6a612b05e840', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86366) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 21 12:10:37 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9011a798-c151-4523-a474-9672d7376452 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-437c373d-e9e4-4402-b37a-5797e377f988" returned: 0 in 0.594s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9011a798-c151-4523-a474-9672d7376452 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-quobyte-437c373d-e9e4-4402-b37a-5797e377f988" released by "delete_volume" :: held 1.470s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:37 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a4e3f3-a1d9-43f4-940b-5afb7788959c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f0b4c53-f739-4fae-83b8-9536a8c53fc4', 'volume_size': 1, 'image_id': '075c5cb5-76f4-465e-af89-38620b0bb10b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/075c5cb5-76f4-465e-af89-38620b0bb10b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c15bbb932e281839d14f6a612b05e840', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3e2165147c2640abab1920a946911c8d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '42db254a8b79a185050f5ad6109f7d68b8da62d058138ca0dbf716e8164d6b42de28150b397f172478ba0e901904dac0e567cb1dea5a46b6c1b403fc3b191f04', 'id': '075c5cb5-76f4-465e-af89-38620b0bb10b', 'created_at': datetime.datetime(2026, 9, 21, 10, 10, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 10, 10, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/075c5cb5-76f4-465e-af89-38620b0bb10b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:37 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d703b33-4822-415f-b0f1-ae5815eeb9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:37 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Volume volume-4f0b4c53-f739-4fae-83b8-9536a8c53fc4 (4f0b4c53-f739-4fae-83b8-9536a8c53fc4): created successfully Sep 21 12:10:37 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d703b33-4822-415f-b0f1-ae5815eeb9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:37 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Flow 'volume_create_manager' (ea11335e-356e-45bc-9db5-aa83cba36486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:37 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-70fa81a0-643e-4896-8b8b-9df42314314b tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Created volume successfully. Sep 21 12:10:37 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-9011a798-c151-4523-a474-9672d7376452 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Created reservations ['86157e6b-dc54-471d-95af-640792806e1d', 'e740c055-4f66-4432-8b91-a317328496d9', '9606bc69-987b-49a5-a599-6650290ee392', '09620bdd-ba96-47b3-9cf3-40aaa952dd1f'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:10:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9011a798-c151-4523-a474-9672d7376452 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9011a798-c151-4523-a474-9672d7376452 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:37 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9011a798-c151-4523-a474-9672d7376452 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:37 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9011a798-c151-4523-a474-9672d7376452 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9011a798-c151-4523-a474-9672d7376452 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9011a798-c151-4523-a474-9672d7376452 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:37 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:10:37 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b6b27424-a5da-4943-bf8a-31cc1f0ab2a1 tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Acquiring lock "cinder-4f0b4c53-f739-4fae-83b8-9536a8c53fc4-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b6b27424-a5da-4943-bf8a-31cc1f0ab2a1 tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Lock "cinder-4f0b4c53-f739-4fae-83b8-9536a8c53fc4-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b6b27424-a5da-4943-bf8a-31cc1f0ab2a1 tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Acquiring lock "cinder-quobyte-4f0b4c53-f739-4fae-83b8-9536a8c53fc4" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b6b27424-a5da-4943-bf8a-31cc1f0ab2a1 tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Lock "cinder-quobyte-4f0b4c53-f739-4fae-83b8-9536a8c53fc4" acquired by "delete_volume" :: waited 0.045s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:38 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dd3fd6-2816-4f74-9459-00147bfa22d6]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:10:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b6b27424-a5da-4943-bf8a-31cc1f0ab2a1 tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f0b4c53-f739-4fae-83b8-9536a8c53fc4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e549a5fc-5391-4fda-bfaa-c0c4e7ffaa58 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "cinder-c9a82855-a1c8-40af-9052-9b6493cf157c-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e549a5fc-5391-4fda-bfaa-c0c4e7ffaa58 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-c9a82855-a1c8-40af-9052-9b6493cf157c-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e549a5fc-5391-4fda-bfaa-c0c4e7ffaa58 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "cinder-quobyte-c9a82855-a1c8-40af-9052-9b6493cf157c" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e549a5fc-5391-4fda-bfaa-c0c4e7ffaa58 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-quobyte-c9a82855-a1c8-40af-9052-9b6493cf157c" acquired by "delete_volume" :: waited 0.042s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:38 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9011a798-c151-4523-a474-9672d7376452 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.838s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:38 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-9011a798-c151-4523-a474-9672d7376452 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:10:38 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f0b4c53-f739-4fae-83b8-9536a8c53fc4 Sep 21 12:10:38 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:38 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-9011a798-c151-4523-a474-9672d7376452 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Deleted volume successfully. Sep 21 12:10:38 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[938965e1-72f7-4393-8c0f-d39996f75a9a]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:10:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e549a5fc-5391-4fda-bfaa-c0c4e7ffaa58 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c9a82855-a1c8-40af-9052-9b6493cf157c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9011a798-c151-4523-a474-9672d7376452 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-437c373d-e9e4-4402-b37a-5797e377f988-delete_volume" released by "delete_volume" :: held 2.976s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:38 devstack sudo[104938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c9a82855-a1c8-40af-9052-9b6493cf157c Sep 21 12:10:38 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:39 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b6b27424-a5da-4943-bf8a-31cc1f0ab2a1 tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f0b4c53-f739-4fae-83b8-9536a8c53fc4" returned: 0 in 0.912s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b6b27424-a5da-4943-bf8a-31cc1f0ab2a1 tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f0b4c53-f739-4fae-83b8-9536a8c53fc4 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:39 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f0b4c53-f739-4fae-83b8-9536a8c53fc4 Sep 21 12:10:39 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:39 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e549a5fc-5391-4fda-bfaa-c0c4e7ffaa58 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c9a82855-a1c8-40af-9052-9b6493cf157c" returned: 0 in 0.920s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e549a5fc-5391-4fda-bfaa-c0c4e7ffaa58 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c9a82855-a1c8-40af-9052-9b6493cf157c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:39 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c9a82855-a1c8-40af-9052-9b6493cf157c Sep 21 12:10:39 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:39 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b6b27424-a5da-4943-bf8a-31cc1f0ab2a1 tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-4f0b4c53-f739-4fae-83b8-9536a8c53fc4" returned: 0 in 0.595s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:39 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b6b27424-a5da-4943-bf8a-31cc1f0ab2a1 tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Lock "cinder-quobyte-4f0b4c53-f739-4fae-83b8-9536a8c53fc4" released by "delete_volume" :: held 1.621s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:39 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-b6b27424-a5da-4943-bf8a-31cc1f0ab2a1 tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Created reservations ['f4f3c024-4bda-41fb-9707-13260ad773d6', 'dea8b606-2fd6-4dc1-96da-1f7d96b5cc58', 'cc40cf5d-8e02-48fb-b5b0-cfa2f08b12d5', '1799c064-a1b0-4660-afbb-71aad0efb0e1'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:10:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b6b27424-a5da-4943-bf8a-31cc1f0ab2a1 tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b6b27424-a5da-4943-bf8a-31cc1f0ab2a1 tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:39 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b6b27424-a5da-4943-bf8a-31cc1f0ab2a1 tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:39 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b6b27424-a5da-4943-bf8a-31cc1f0ab2a1 tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b6b27424-a5da-4943-bf8a-31cc1f0ab2a1 tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b6b27424-a5da-4943-bf8a-31cc1f0ab2a1 tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:40 devstack sudo[104952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:10:40 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:40 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e549a5fc-5391-4fda-bfaa-c0c4e7ffaa58 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c9a82855-a1c8-40af-9052-9b6493cf157c" returned: 0 in 0.794s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e549a5fc-5391-4fda-bfaa-c0c4e7ffaa58 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-quobyte-c9a82855-a1c8-40af-9052-9b6493cf157c" released by "delete_volume" :: held 1.866s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:40 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-e549a5fc-5391-4fda-bfaa-c0c4e7ffaa58 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Created reservations ['96d18cdd-eb7d-4e94-8c32-1f77252a3e87', '8e8f83e1-190c-4ae6-95ac-742cd5b0f84e', 'c9edd733-286e-40e2-8617-c0b5c1a6e40f', '3f209b94-2a2a-4ec2-8e31-09ccd99ed9f8'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:10:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e549a5fc-5391-4fda-bfaa-c0c4e7ffaa58 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e549a5fc-5391-4fda-bfaa-c0c4e7ffaa58 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:40 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e549a5fc-5391-4fda-bfaa-c0c4e7ffaa58 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:40 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e549a5fc-5391-4fda-bfaa-c0c4e7ffaa58 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e549a5fc-5391-4fda-bfaa-c0c4e7ffaa58 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e549a5fc-5391-4fda-bfaa-c0c4e7ffaa58 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:41 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-89f3e0e5-0010-410e-abc1-42360b598c60 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "cinder-1defe58c-22de-4fb9-a6c2-d40620e1a532-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:41 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-89f3e0e5-0010-410e-abc1-42360b598c60 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-1defe58c-22de-4fb9-a6c2-d40620e1a532-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:41 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:10:41 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:41 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-89f3e0e5-0010-410e-abc1-42360b598c60 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "cinder-quobyte-1defe58c-22de-4fb9-a6c2-d40620e1a532" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:41 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-89f3e0e5-0010-410e-abc1-42360b598c60 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-quobyte-1defe58c-22de-4fb9-a6c2-d40620e1a532" acquired by "delete_volume" :: waited 0.039s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:41 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b6b27424-a5da-4943-bf8a-31cc1f0ab2a1 tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 1.295s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:41 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-b6b27424-a5da-4943-bf8a-31cc1f0ab2a1 tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:10:41 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-b6b27424-a5da-4943-bf8a-31cc1f0ab2a1 tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Deleted volume successfully. Sep 21 12:10:41 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bbe108-969e-4690-a35f-841361b743fc]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:10:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-89f3e0e5-0010-410e-abc1-42360b598c60 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1defe58c-22de-4fb9-a6c2-d40620e1a532 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:41 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b6b27424-a5da-4943-bf8a-31cc1f0ab2a1 tempest-VolumeAndVolumeTypeFromImageTest-522951328 None] Lock "cinder-4f0b4c53-f739-4fae-83b8-9536a8c53fc4-delete_volume" released by "delete_volume" :: held 3.506s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:41 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1defe58c-22de-4fb9-a6c2-d40620e1a532 Sep 21 12:10:41 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:41 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e549a5fc-5391-4fda-bfaa-c0c4e7ffaa58 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.728s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:41 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-e549a5fc-5391-4fda-bfaa-c0c4e7ffaa58 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:10:41 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-e549a5fc-5391-4fda-bfaa-c0c4e7ffaa58 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Deleted volume successfully. Sep 21 12:10:41 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e549a5fc-5391-4fda-bfaa-c0c4e7ffaa58 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-c9a82855-a1c8-40af-9052-9b6493cf157c-delete_volume" released by "delete_volume" :: held 3.593s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:42 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-89f3e0e5-0010-410e-abc1-42360b598c60 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1defe58c-22de-4fb9-a6c2-d40620e1a532" returned: 0 in 0.986s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-89f3e0e5-0010-410e-abc1-42360b598c60 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1defe58c-22de-4fb9-a6c2-d40620e1a532 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:42 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1defe58c-22de-4fb9-a6c2-d40620e1a532 Sep 21 12:10:42 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:42 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-89f3e0e5-0010-410e-abc1-42360b598c60 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1defe58c-22de-4fb9-a6c2-d40620e1a532" returned: 0 in 0.521s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-89f3e0e5-0010-410e-abc1-42360b598c60 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-quobyte-1defe58c-22de-4fb9-a6c2-d40620e1a532" released by "delete_volume" :: held 1.706s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:43 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-89f3e0e5-0010-410e-abc1-42360b598c60 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Created reservations ['7aaa1dfc-87e1-4fc3-bad0-1ce7df6f3016', 'a230629b-121e-453a-9167-dd4386e314fa', 'b5c60cbf-07b1-4854-a898-ee0c11f5889b', '06240836-a6f9-430e-8519-689c6f96ea24'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:10:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-89f3e0e5-0010-410e-abc1-42360b598c60 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-89f3e0e5-0010-410e-abc1-42360b598c60 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:43 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-89f3e0e5-0010-410e-abc1-42360b598c60 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:43 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-89f3e0e5-0010-410e-abc1-42360b598c60 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-89f3e0e5-0010-410e-abc1-42360b598c60 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-89f3e0e5-0010-410e-abc1-42360b598c60 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:43 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:10:43 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:43 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9e04cee8-f8a4-4f39-82bf-5404322e419e tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "cinder-f3546e49-eb7f-49db-a720-087bbe03c246-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:43 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9e04cee8-f8a4-4f39-82bf-5404322e419e tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-f3546e49-eb7f-49db-a720-087bbe03c246-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:43 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9e04cee8-f8a4-4f39-82bf-5404322e419e tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "cinder-quobyte-f3546e49-eb7f-49db-a720-087bbe03c246" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:43 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c80f58fa-97ae-4061-8e8b-80c491a605aa" returned: 0 in 9.713s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:43 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Image conversion details: src /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0, size 1024.00 MB, duration 9.71 sec, destination /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c80f58fa-97ae-4061-8e8b-80c491a605aa {{(pid=86366) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 12:10:43 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Converted 1024.00 MB image at 105.42 MB/s Sep 21 12:10:43 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c80f58fa-97ae-4061-8e8b-80c491a605aa is being set with open permissions: ugo+rw Sep 21 12:10:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c80f58fa-97ae-4061-8e8b-80c491a605aa {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:43 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9e04cee8-f8a4-4f39-82bf-5404322e419e tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-quobyte-f3546e49-eb7f-49db-a720-087bbe03c246" acquired by "delete_volume" :: waited 0.043s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:43 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c80f58fa-97ae-4061-8e8b-80c491a605aa Sep 21 12:10:43 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:43 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[0280dc02-f7cf-4132-8752-5dd37497ef47]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:10:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9e04cee8-f8a4-4f39-82bf-5404322e419e tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f3546e49-eb7f-49db-a720-087bbe03c246 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:43 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-89f3e0e5-0010-410e-abc1-42360b598c60 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.586s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:43 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-89f3e0e5-0010-410e-abc1-42360b598c60 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:10:43 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-89f3e0e5-0010-410e-abc1-42360b598c60 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Deleted volume successfully. Sep 21 12:10:43 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-89f3e0e5-0010-410e-abc1-42360b598c60 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-1defe58c-22de-4fb9-a6c2-d40620e1a532-delete_volume" released by "delete_volume" :: held 2.826s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:43 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f3546e49-eb7f-49db-a720-087bbe03c246 Sep 21 12:10:43 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:44 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c80f58fa-97ae-4061-8e8b-80c491a605aa" returned: 0 in 0.342s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:44 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Lock "cinder-quobyte-c80f58fa-97ae-4061-8e8b-80c491a605aa" released by "_copy_volume_from_snapshot" :: held 11.313s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:44 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Lock "cinder-quobyte-4e725358-e0d6-4ad9-9690-0966e2d45bc5-c80f58fa-97ae-4061-8e8b-80c491a605aa" released by "_create_volume_from_snapshot" :: held 11.408s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.438s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b12e7790-00fd-4c76-939f-ea9e9b2ff012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c80f58fa-97ae-4061-8e8b-80c491a605aa', 'volume_size': 1, 'snapshot_id': '4e725358-e0d6-4ad9-9690-0966e2d45bc5'}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fbb10eb-2971-4d3b-b888-87d02369d332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:44 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Volume volume-c80f58fa-97ae-4061-8e8b-80c491a605aa (c80f58fa-97ae-4061-8e8b-80c491a605aa): created successfully Sep 21 12:10:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fbb10eb-2971-4d3b-b888-87d02369d332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Flow 'volume_create_manager' (cf658151-e155-42f5-a595-282b0bd7353b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:44 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1f83c0a4-31b5-4a84-9b3a-18771cae4149 tempest-VolumeDependencyTests-1245787338 None] Created volume successfully. Sep 21 12:10:44 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9e04cee8-f8a4-4f39-82bf-5404322e419e tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f3546e49-eb7f-49db-a720-087bbe03c246" returned: 0 in 0.645s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9e04cee8-f8a4-4f39-82bf-5404322e419e tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f3546e49-eb7f-49db-a720-087bbe03c246 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:44 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f3546e49-eb7f-49db-a720-087bbe03c246 Sep 21 12:10:44 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:44 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9e04cee8-f8a4-4f39-82bf-5404322e419e tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f3546e49-eb7f-49db-a720-087bbe03c246" returned: 0 in 0.366s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:44 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9e04cee8-f8a4-4f39-82bf-5404322e419e tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-quobyte-f3546e49-eb7f-49db-a720-087bbe03c246" released by "delete_volume" :: held 1.090s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:44 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-9e04cee8-f8a4-4f39-82bf-5404322e419e tempest-CreateVolumesFromSnapshotTest-1973825980 None] Created reservations ['4057171a-5732-4803-8481-c6aae4a4a926', '0bcf4dbe-71fa-461b-a67c-ee054580b569', 'd4d70632-0348-43ee-895e-d92e7e1d199f', '32c11ef0-e0a8-4231-9e29-c39cce8607d9'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:10:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9e04cee8-f8a4-4f39-82bf-5404322e419e tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9e04cee8-f8a4-4f39-82bf-5404322e419e tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9e04cee8-f8a4-4f39-82bf-5404322e419e tempest-CreateVolumesFromSnapshotTest-1973825980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9e04cee8-f8a4-4f39-82bf-5404322e419e tempest-CreateVolumesFromSnapshotTest-1973825980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9e04cee8-f8a4-4f39-82bf-5404322e419e tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9e04cee8-f8a4-4f39-82bf-5404322e419e tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:45 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:10:45 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7010fb8b-36c8-4c40-b384-b4ef020b8c00 tempest-VolumeDependencyTests-1245787338 None] Acquiring lock "cinder-4e725358-e0d6-4ad9-9690-0966e2d45bc5-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7010fb8b-36c8-4c40-b384-b4ef020b8c00 tempest-VolumeDependencyTests-1245787338 None] Lock "cinder-4e725358-e0d6-4ad9-9690-0966e2d45bc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7010fb8b-36c8-4c40-b384-b4ef020b8c00 tempest-VolumeDependencyTests-1245787338 None] Acquiring lock "cinder-quobyte-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7010fb8b-36c8-4c40-b384-b4ef020b8c00 tempest-VolumeDependencyTests-1245787338 None] Lock "cinder-quobyte-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7010fb8b-36c8-4c40-b384-b4ef020b8c00 tempest-VolumeDependencyTests-1245787338 None] Acquiring lock "cinder-quobyte-4e725358-e0d6-4ad9-9690-0966e2d45bc5" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7010fb8b-36c8-4c40-b384-b4ef020b8c00 tempest-VolumeDependencyTests-1245787338 None] Lock "cinder-quobyte-4e725358-e0d6-4ad9-9690-0966e2d45bc5" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-7010fb8b-36c8-4c40-b384-b4ef020b8c00 tempest-VolumeDependencyTests-1245787338 None] Deleting offline snapshot 4e725358-e0d6-4ad9-9690-0966e2d45bc5 of volume 0ea0548a-1d73-4f9c-badd-61dce6a2e0b0 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:10:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-7010fb8b-36c8-4c40-b384-b4ef020b8c00 tempest-VolumeDependencyTests-1245787338 None] snapshot_file for this snap is: volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.4e725358-e0d6-4ad9-9690-0966e2d45bc5 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:10:45 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c1314d-30cf-48f1-869a-67c9541cf58f]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:10:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7010fb8b-36c8-4c40-b384-b4ef020b8c00 tempest-VolumeDependencyTests-1245787338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.4e725358-e0d6-4ad9-9690-0966e2d45bc5 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:45 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.4e725358-e0d6-4ad9-9690-0966e2d45bc5 Sep 21 12:10:45 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:45 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9e04cee8-f8a4-4f39-82bf-5404322e419e tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.471s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:45 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-9e04cee8-f8a4-4f39-82bf-5404322e419e tempest-CreateVolumesFromSnapshotTest-1973825980 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:10:45 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-9e04cee8-f8a4-4f39-82bf-5404322e419e tempest-CreateVolumesFromSnapshotTest-1973825980 None] Deleted volume successfully. Sep 21 12:10:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9e04cee8-f8a4-4f39-82bf-5404322e419e tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-f3546e49-eb7f-49db-a720-087bbe03c246-delete_volume" released by "delete_volume" :: held 1.967s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1e405efd-c000-4ae4-aa7f-ccffde45814b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "cinder-590d3003-1d02-488e-a253-dbc86f36b063-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1e405efd-c000-4ae4-aa7f-ccffde45814b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-590d3003-1d02-488e-a253-dbc86f36b063-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1e405efd-c000-4ae4-aa7f-ccffde45814b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "cinder-quobyte-e0a7d833-a65a-497b-8aff-133d901f0501" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:45 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7010fb8b-36c8-4c40-b384-b4ef020b8c00 tempest-VolumeDependencyTests-1245787338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.4e725358-e0d6-4ad9-9690-0966e2d45bc5" returned: 0 in 0.611s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-7010fb8b-36c8-4c40-b384-b4ef020b8c00 tempest-VolumeDependencyTests-1245787338 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:10:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1e405efd-c000-4ae4-aa7f-ccffde45814b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-quobyte-e0a7d833-a65a-497b-8aff-133d901f0501" acquired by "delete_snapshot" :: waited 0.069s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1e405efd-c000-4ae4-aa7f-ccffde45814b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "cinder-quobyte-590d3003-1d02-488e-a253-dbc86f36b063" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:45 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d83d5a-6548-47b7-b564-d05aa6efcb4a]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:10:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7010fb8b-36c8-4c40-b384-b4ef020b8c00 tempest-VolumeDependencyTests-1245787338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:46 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1e405efd-c000-4ae4-aa7f-ccffde45814b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-quobyte-590d3003-1d02-488e-a253-dbc86f36b063" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1e405efd-c000-4ae4-aa7f-ccffde45814b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Deleting offline snapshot 590d3003-1d02-488e-a253-dbc86f36b063 of volume e0a7d833-a65a-497b-8aff-133d901f0501 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:10:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1e405efd-c000-4ae4-aa7f-ccffde45814b tempest-CreateVolumesFromSnapshotTest-1973825980 None] snapshot_file for this snap is: volume-e0a7d833-a65a-497b-8aff-133d901f0501.590d3003-1d02-488e-a253-dbc86f36b063 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:10:46 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[b219f925-3f70-432b-9ed8-a3da5604ae8c]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:10:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1e405efd-c000-4ae4-aa7f-ccffde45814b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501.590d3003-1d02-488e-a253-dbc86f36b063 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:46 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0 Sep 21 12:10:46 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:46 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501.590d3003-1d02-488e-a253-dbc86f36b063 Sep 21 12:10:46 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:46 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1e405efd-c000-4ae4-aa7f-ccffde45814b tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501.590d3003-1d02-488e-a253-dbc86f36b063" returned: 0 in 0.544s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1e405efd-c000-4ae4-aa7f-ccffde45814b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0a7d833-a65a-497b-8aff-133d901f0501(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:10:46 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bae938-793e-4a64-8f0b-65c2fa951f4c]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:10:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1e405efd-c000-4ae4-aa7f-ccffde45814b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:46 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7010fb8b-36c8-4c40-b384-b4ef020b8c00 tempest-VolumeDependencyTests-1245787338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0" returned: 0 in 0.788s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7010fb8b-36c8-4c40-b384-b4ef020b8c00 tempest-VolumeDependencyTests-1245787338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.4e725358-e0d6-4ad9-9690-0966e2d45bc5 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:46 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.4e725358-e0d6-4ad9-9690-0966e2d45bc5 Sep 21 12:10:46 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:46 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501 Sep 21 12:10:46 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:47 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7010fb8b-36c8-4c40-b384-b4ef020b8c00 tempest-VolumeDependencyTests-1245787338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.4e725358-e0d6-4ad9-9690-0966e2d45bc5" returned: 0 in 0.497s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7010fb8b-36c8-4c40-b384-b4ef020b8c00 tempest-VolumeDependencyTests-1245787338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.4e725358-e0d6-4ad9-9690-0966e2d45bc5 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:47 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1e405efd-c000-4ae4-aa7f-ccffde45814b tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501" returned: 0 in 0.600s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1e405efd-c000-4ae4-aa7f-ccffde45814b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501.590d3003-1d02-488e-a253-dbc86f36b063 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:47 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.4e725358-e0d6-4ad9-9690-0966e2d45bc5 Sep 21 12:10:47 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:47 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501.590d3003-1d02-488e-a253-dbc86f36b063 Sep 21 12:10:47 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:47 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7010fb8b-36c8-4c40-b384-b4ef020b8c00 tempest-VolumeDependencyTests-1245787338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0.4e725358-e0d6-4ad9-9690-0966e2d45bc5" returned: 0 in 0.335s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7010fb8b-36c8-4c40-b384-b4ef020b8c00 tempest-VolumeDependencyTests-1245787338 None] Lock "cinder-quobyte-4e725358-e0d6-4ad9-9690-0966e2d45bc5" released by "_delete_snapshot" :: held 2.409s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7010fb8b-36c8-4c40-b384-b4ef020b8c00 tempest-VolumeDependencyTests-1245787338 None] Lock "cinder-quobyte-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0" released by "delete_snapshot" :: held 2.445s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:47 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-7010fb8b-36c8-4c40-b384-b4ef020b8c00 tempest-VolumeDependencyTests-1245787338 None] Created reservations ['cd7a7625-fb7f-4903-80ec-58a9361d93bb', '7347f06f-867e-45db-85d4-6c5d6372c74d', 'bda1e751-41aa-4c6f-b35c-75e1be29bda5', '2c24e8cc-075e-43cf-8348-569cfd276acb'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:10:47 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1e405efd-c000-4ae4-aa7f-ccffde45814b tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501.590d3003-1d02-488e-a253-dbc86f36b063" returned: 0 in 0.493s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1e405efd-c000-4ae4-aa7f-ccffde45814b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501.590d3003-1d02-488e-a253-dbc86f36b063 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:47 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501.590d3003-1d02-488e-a253-dbc86f36b063 Sep 21 12:10:47 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:47 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-7010fb8b-36c8-4c40-b384-b4ef020b8c00 tempest-VolumeDependencyTests-1245787338 None] Delete snapshot completed successfully. Sep 21 12:10:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7010fb8b-36c8-4c40-b384-b4ef020b8c00 tempest-VolumeDependencyTests-1245787338 None] Lock "cinder-4e725358-e0d6-4ad9-9690-0966e2d45bc5-delete_snapshot" released by "delete_snapshot" :: held 2.702s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:48 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1e405efd-c000-4ae4-aa7f-ccffde45814b tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501.590d3003-1d02-488e-a253-dbc86f36b063" returned: 0 in 0.350s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:48 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1e405efd-c000-4ae4-aa7f-ccffde45814b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-quobyte-590d3003-1d02-488e-a253-dbc86f36b063" released by "_delete_snapshot" :: held 2.168s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:48 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1e405efd-c000-4ae4-aa7f-ccffde45814b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-quobyte-e0a7d833-a65a-497b-8aff-133d901f0501" released by "delete_snapshot" :: held 2.219s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:48 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-1e405efd-c000-4ae4-aa7f-ccffde45814b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Created reservations ['1a347be4-0ca0-43a4-a332-38f220f37e97', 'b5d42f80-a04a-49f3-be05-cf289aef73cc', 'ccf163c3-4b17-4978-8c89-1227e1f59745', '9d591a27-9403-4173-a9d9-a38c8a846cb1'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:10:48 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1e405efd-c000-4ae4-aa7f-ccffde45814b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Delete snapshot completed successfully. Sep 21 12:10:48 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1e405efd-c000-4ae4-aa7f-ccffde45814b tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-590d3003-1d02-488e-a253-dbc86f36b063-delete_snapshot" released by "delete_snapshot" :: held 2.493s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:48 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f0248a23-1c4f-4c9a-b48f-751fe544607e tempest-VolumeDependencyTests-1245787338 None] Acquiring lock "cinder-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:48 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f0248a23-1c4f-4c9a-b48f-751fe544607e tempest-VolumeDependencyTests-1245787338 None] Lock "cinder-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:48 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f0248a23-1c4f-4c9a-b48f-751fe544607e tempest-VolumeDependencyTests-1245787338 None] Acquiring lock "cinder-quobyte-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:48 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f0248a23-1c4f-4c9a-b48f-751fe544607e tempest-VolumeDependencyTests-1245787338 None] Lock "cinder-quobyte-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0" acquired by "delete_volume" :: waited 0.016s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:48 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a6e91a-4ba8-47a0-868b-dfdb0c55d20b]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:10:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f0248a23-1c4f-4c9a-b48f-751fe544607e tempest-VolumeDependencyTests-1245787338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:48 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0 Sep 21 12:10:48 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:49 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f0248a23-1c4f-4c9a-b48f-751fe544607e tempest-VolumeDependencyTests-1245787338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0" returned: 0 in 0.475s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f0248a23-1c4f-4c9a-b48f-751fe544607e tempest-VolumeDependencyTests-1245787338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:49 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0 Sep 21 12:10:49 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-37adb385-baaf-4e46-9240-e207cc996335 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "cinder-e0a7d833-a65a-497b-8aff-133d901f0501-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-37adb385-baaf-4e46-9240-e207cc996335 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-e0a7d833-a65a-497b-8aff-133d901f0501-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-37adb385-baaf-4e46-9240-e207cc996335 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "cinder-quobyte-e0a7d833-a65a-497b-8aff-133d901f0501" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-37adb385-baaf-4e46-9240-e207cc996335 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-quobyte-e0a7d833-a65a-497b-8aff-133d901f0501" acquired by "delete_volume" :: waited 0.026s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:49 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f0248a23-1c4f-4c9a-b48f-751fe544607e tempest-VolumeDependencyTests-1245787338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0" returned: 0 in 0.377s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ef30d6-19e8-4564-8c12-5f68b45f8831]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-37adb385-baaf-4e46-9240-e207cc996335 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f0248a23-1c4f-4c9a-b48f-751fe544607e tempest-VolumeDependencyTests-1245787338 None] Lock "cinder-quobyte-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0" released by "delete_volume" :: held 0.960s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-f0248a23-1c4f-4c9a-b48f-751fe544607e tempest-VolumeDependencyTests-1245787338 None] Created reservations ['2685d7a6-7e5e-4837-8a7b-945d33c935f9', '68ce18a5-eb9f-402e-9813-27a7705d1308', '85437b82-29bc-4216-b5b8-d5e11c24a8f1', 'e3cf47dc-b6cc-4619-b4ba-d7db43170c0f'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:10:49 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501 Sep 21 12:10:49 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Flow 'volume_create_manager' (bc81a3d3-0d51-42c2-9786-ce59cee2ac0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429505dc-b8cc-41a6-a6de-7e530d3388cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Flow 'volume_create_manager' (de8ee950-f4c8-462f-96a7-3f96d1a2731c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ab11cb-ffae-4db8-864d-f588e6327fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (429505dc-b8cc-41a6-a6de-7e530d3388cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-141005757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b099f7-c212-4fdb-b5c7-9a8195c1dab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ec89d4ae5974e21be22a3468e9cdc5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:50Z,use_quota=True,user_id='bbb90798e0f84460a37996fc516714da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (794255e5-f058-4e4b-8549-d22b39b73f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (794255e5-f058-4e4b-8549-d22b39b73f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (201a0c61-78fc-44dd-94bc-3a87ca10b613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (201a0c61-78fc-44dd-94bc-3a87ca10b613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90b099f7-c212-4fdb-b5c7-9a8195c1dab9', 'volume_name': 'volume-90b099f7-c212-4fdb-b5c7-9a8195c1dab9', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ed19a3-31db-4561-80e5-7a869b920f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ed19a3-31db-4561-80e5-7a869b920f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c513d8-186f-40a5-a61d-49e57350bf29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:49 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Volume 90b099f7-c212-4fdb-b5c7-9a8195c1dab9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90b099f7-c212-4fdb-b5c7-9a8195c1dab9', 'volume_size': 1} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-141005757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b099f7-c212-4fdb-b5c7-9a8195c1dab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ec89d4ae5974e21be22a3468e9cdc5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:50Z,use_quota=True,user_id='bbb90798e0f84460a37996fc516714da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Creating volume 90b099f7-c212-4fdb-b5c7-9a8195c1dab9 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:10:49 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90b099f7-c212-4fdb-b5c7-9a8195c1dab9 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:49 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90b099f7-c212-4fdb-b5c7-9a8195c1dab9 1073741824 Sep 21 12:10:49 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73ab11cb-ffae-4db8-864d-f588e6327fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1733158679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d12e0cbd-b4ef-4105-9652-6c25ade52988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bcb7246ecc3474aad329627480071bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:50Z,use_quota=True,user_id='e9b5c92ac16340cf854be7729fa0fe79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f5e98a9-aa19-405e-a128-59e4fde6987d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f5e98a9-aa19-405e-a128-59e4fde6987d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c9f39b-1b45-441d-be8b-638f4d53a1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c9f39b-1b45-441d-be8b-638f4d53a1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd12e0cbd-b4ef-4105-9652-6c25ade52988', 'volume_name': 'volume-d12e0cbd-b4ef-4105-9652-6c25ade52988', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3935c2f1-16af-4f11-b443-4f096f2c8ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3935c2f1-16af-4f11-b443-4f096f2c8ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c37aa3-d8df-43e4-9182-2fb62c3d6408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:49 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Volume d12e0cbd-b4ef-4105-9652-6c25ade52988: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d12e0cbd-b4ef-4105-9652-6c25ade52988', 'volume_size': 1} Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:49 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:49 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Flow 'volume_create_manager' (262048bb-f725-418d-835a-c2068ce2a36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a83209-b113-4d8f-b0ee-ace362adbf52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f0248a23-1c4f-4c9a-b48f-751fe544607e tempest-VolumeDependencyTests-1245787338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f0248a23-1c4f-4c9a-b48f-751fe544607e tempest-VolumeDependencyTests-1245787338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f0248a23-1c4f-4c9a-b48f-751fe544607e tempest-VolumeDependencyTests-1245787338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f0248a23-1c4f-4c9a-b48f-751fe544607e tempest-VolumeDependencyTests-1245787338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f0248a23-1c4f-4c9a-b48f-751fe544607e tempest-VolumeDependencyTests-1245787338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f0248a23-1c4f-4c9a-b48f-751fe544607e tempest-VolumeDependencyTests-1245787338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-37adb385-baaf-4e46-9240-e207cc996335 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501" returned: 0 in 0.584s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-37adb385-baaf-4e46-9240-e207cc996335 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:50 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a83209-b113-4d8f-b0ee-ace362adbf52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-524345988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4d9572-47b6-4ea0-9ad3-207253cbc024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bcb7246ecc3474aad329627480071bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:50Z,use_quota=True,user_id='e9b5c92ac16340cf854be7729fa0fe79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:50 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42174b5-5ccd-42b4-aaa8-8467077d3edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:50 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501 Sep 21 12:10:50 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42174b5-5ccd-42b4-aaa8-8467077d3edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (921a85b6-0eee-4738-929a-b00290e66d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (921a85b6-0eee-4738-929a-b00290e66d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba4d9572-47b6-4ea0-9ad3-207253cbc024', 'volume_name': 'volume-ba4d9572-47b6-4ea0-9ad3-207253cbc024', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ce5081-596a-490b-a0c8-3c20822f4d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ce5081-596a-490b-a0c8-3c20822f4d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (877faa95-44fc-45d1-ad87-00eebe0af4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:50 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Volume ba4d9572-47b6-4ea0-9ad3-207253cbc024: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba4d9572-47b6-4ea0-9ad3-207253cbc024', 'volume_size': 1} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b3061792-e4af-4160-9c58-c8c316db1d27 tempest-VolumeDependencyTests-1245787338 None] Acquiring lock "cinder-c80f58fa-97ae-4061-8e8b-80c491a605aa-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b3061792-e4af-4160-9c58-c8c316db1d27 tempest-VolumeDependencyTests-1245787338 None] Lock "cinder-c80f58fa-97ae-4061-8e8b-80c491a605aa-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b3061792-e4af-4160-9c58-c8c316db1d27 tempest-VolumeDependencyTests-1245787338 None] Acquiring lock "cinder-quobyte-c80f58fa-97ae-4061-8e8b-80c491a605aa" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b3061792-e4af-4160-9c58-c8c316db1d27 tempest-VolumeDependencyTests-1245787338 None] Lock "cinder-quobyte-c80f58fa-97ae-4061-8e8b-80c491a605aa" acquired by "delete_volume" :: waited 0.052s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:50 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-37adb385-baaf-4e46-9240-e207cc996335 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e0a7d833-a65a-497b-8aff-133d901f0501" returned: 0 in 0.507s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5092c0-df66-4632-a876-a429586db355]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b3061792-e4af-4160-9c58-c8c316db1d27 tempest-VolumeDependencyTests-1245787338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c80f58fa-97ae-4061-8e8b-80c491a605aa {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:50 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f0248a23-1c4f-4c9a-b48f-751fe544607e tempest-VolumeDependencyTests-1245787338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.600s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-f0248a23-1c4f-4c9a-b48f-751fe544607e tempest-VolumeDependencyTests-1245787338 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-37adb385-baaf-4e46-9240-e207cc996335 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-quobyte-e0a7d833-a65a-497b-8aff-133d901f0501" released by "delete_volume" :: held 1.283s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:50 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:50 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-f0248a23-1c4f-4c9a-b48f-751fe544607e tempest-VolumeDependencyTests-1245787338 None] Deleted volume successfully. Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90b099f7-c212-4fdb-b5c7-9a8195c1dab9 1073741824" returned: 0 in 0.845s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:50 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c80f58fa-97ae-4061-8e8b-80c491a605aa Sep 21 12:10:50 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f0248a23-1c4f-4c9a-b48f-751fe544607e tempest-VolumeDependencyTests-1245787338 None] Lock "cinder-0ea0548a-1d73-4f9c-badd-61dce6a2e0b0-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Flow 'volume_create_manager' (19ae68d5-ff32-4a51-8683-4cb9cfa62f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2d9ad1b-06ca-4f92-8a9f-67c072165d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2d9ad1b-06ca-4f92-8a9f-67c072165d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-458072712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed66cd1-fa61-4092-b1e5-cd7b588f0120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bcb7246ecc3474aad329627480071bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:51Z,use_quota=True,user_id='e9b5c92ac16340cf854be7729fa0fe79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fad873-097a-4d65-a68d-47556b579971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0fad873-097a-4d65-a68d-47556b579971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e620ca1c-f832-4786-9ffe-cccc3ca9357a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e620ca1c-f832-4786-9ffe-cccc3ca9357a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ed66cd1-fa61-4092-b1e5-cd7b588f0120', 'volume_name': 'volume-6ed66cd1-fa61-4092-b1e5-cd7b588f0120', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53db83b9-c483-431f-a07a-eeb7f9c9734f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53db83b9-c483-431f-a07a-eeb7f9c9734f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f952cf9-36e8-47e1-b2dd-1cb28b617aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:50 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Volume 6ed66cd1-fa61-4092-b1e5-cd7b588f0120: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ed66cd1-fa61-4092-b1e5-cd7b588f0120', 'volume_size': 1} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90b099f7-c212-4fdb-b5c7-9a8195c1dab9 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:50 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-37adb385-baaf-4e46-9240-e207cc996335 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Created reservations ['c2b8ac4e-fa01-4006-affe-4c8d98fb78b0', '0e01bbc6-760d-40f2-ab87-62b2367ecde2', '0ec4f538-8993-4407-a4bb-1b58fba0d904', 'fb2f7a2f-f1d1-4d00-b909-5d316e27e14b'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:10:50 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90b099f7-c212-4fdb-b5c7-9a8195c1dab9 Sep 21 12:10:50 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-37adb385-baaf-4e46-9240-e207cc996335 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-37adb385-baaf-4e46-9240-e207cc996335 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-37adb385-baaf-4e46-9240-e207cc996335 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-37adb385-baaf-4e46-9240-e207cc996335 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-37adb385-baaf-4e46-9240-e207cc996335 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-37adb385-baaf-4e46-9240-e207cc996335 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:51 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b3061792-e4af-4160-9c58-c8c316db1d27 tempest-VolumeDependencyTests-1245787338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c80f58fa-97ae-4061-8e8b-80c491a605aa" returned: 0 in 0.552s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b3061792-e4af-4160-9c58-c8c316db1d27 tempest-VolumeDependencyTests-1245787338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c80f58fa-97ae-4061-8e8b-80c491a605aa {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:51 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:10:51 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:51 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c80f58fa-97ae-4061-8e8b-80c491a605aa Sep 21 12:10:51 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:10:51 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Flow 'volume_create_manager' (4b46ebe4-f90f-4a8d-81df-cb3be8496743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb5cfcb-bad7-4625-8547-c95f6b05024e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90b099f7-c212-4fdb-b5c7-9a8195c1dab9" returned: 0 in 0.438s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.437s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1733158679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d12e0cbd-b4ef-4105-9652-6c25ade52988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bcb7246ecc3474aad329627480071bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:50Z,use_quota=True,user_id='e9b5c92ac16340cf854be7729fa0fe79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Creating volume d12e0cbd-b4ef-4105-9652-6c25ade52988 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:10:51 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d12e0cbd-b4ef-4105-9652-6c25ade52988 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb5cfcb-bad7-4625-8547-c95f6b05024e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1590214365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f55d58-2c45-4c97-a6f6-041eed2c5edc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bcb7246ecc3474aad329627480071bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:51Z,use_quota=True,user_id='e9b5c92ac16340cf854be7729fa0fe79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662693d9-50a5-4b0a-9636-78517ebc0422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:51 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d12e0cbd-b4ef-4105-9652-6c25ade52988 1073741824 Sep 21 12:10:51 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662693d9-50a5-4b0a-9636-78517ebc0422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c10826-ee7c-4ffd-8298-a87dd9dae4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:51 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c10826-ee7c-4ffd-8298-a87dd9dae4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2f55d58-2c45-4c97-a6f6-041eed2c5edc', 'volume_name': 'volume-a2f55d58-2c45-4c97-a6f6-041eed2c5edc', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa20a0e1-99f3-4287-8aa0-ed5a3149a162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa20a0e1-99f3-4287-8aa0-ed5a3149a162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e7749f-4ff6-40a8-bbd4-a2d2df9d53a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:51 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Volume a2f55d58-2c45-4c97-a6f6-041eed2c5edc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2f55d58-2c45-4c97-a6f6-041eed2c5edc', 'volume_size': 1} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c513d8-186f-40a5-a61d-49e57350bf29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90b099f7-c212-4fdb-b5c7-9a8195c1dab9', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba50d89-9280-4d3f-8dd6-7eb630a7f27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-37adb385-baaf-4e46-9240-e207cc996335 tempest-CreateVolumesFromSnapshotTest-1973825980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.454s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-37adb385-baaf-4e46-9240-e207cc996335 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:10:51 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-37adb385-baaf-4e46-9240-e207cc996335 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Deleted volume successfully. Sep 21 12:10:51 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Volume volume-90b099f7-c212-4fdb-b5c7-9a8195c1dab9 (90b099f7-c212-4fdb-b5c7-9a8195c1dab9): created successfully Sep 21 12:10:51 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba50d89-9280-4d3f-8dd6-7eb630a7f27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Flow 'volume_create_manager' (bc81a3d3-0d51-42c2-9786-ce59cee2ac0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b3061792-e4af-4160-9c58-c8c316db1d27 tempest-VolumeDependencyTests-1245787338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-c80f58fa-97ae-4061-8e8b-80c491a605aa" returned: 0 in 0.472s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b3061792-e4af-4160-9c58-c8c316db1d27 tempest-VolumeDependencyTests-1245787338 None] Lock "cinder-quobyte-c80f58fa-97ae-4061-8e8b-80c491a605aa" released by "delete_volume" :: held 1.144s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-37adb385-baaf-4e46-9240-e207cc996335 tempest-CreateVolumesFromSnapshotTest-1973825980 None] Lock "cinder-e0a7d833-a65a-497b-8aff-133d901f0501-delete_volume" released by "delete_volume" :: held 2.414s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:51 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-fa66b08b-199f-483b-962a-4d6e1fad797a tempest-ProjectReaderTests-260641808 None] Created volume successfully. Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-b3061792-e4af-4160-9c58-c8c316db1d27 tempest-VolumeDependencyTests-1245787338 None] Created reservations ['08845a01-d437-43df-94b1-e5b671488676', 'e6e4383f-82e4-4197-8edb-2a897d5d132b', '16e8ece0-1fd0-49f8-a457-f4bf132664c0', 'a9f90996-ceb7-4949-9b5e-b5ecf0d7d213'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Flow 'volume_create_manager' (bba9ddd8-1966-41a2-9fea-325eee90d074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8306b639-6a82-4a55-82b0-8b0d6b7ecf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b3061792-e4af-4160-9c58-c8c316db1d27 tempest-VolumeDependencyTests-1245787338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b3061792-e4af-4160-9c58-c8c316db1d27 tempest-VolumeDependencyTests-1245787338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b3061792-e4af-4160-9c58-c8c316db1d27 tempest-VolumeDependencyTests-1245787338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b3061792-e4af-4160-9c58-c8c316db1d27 tempest-VolumeDependencyTests-1245787338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b3061792-e4af-4160-9c58-c8c316db1d27 tempest-VolumeDependencyTests-1245787338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b3061792-e4af-4160-9c58-c8c316db1d27 tempest-VolumeDependencyTests-1245787338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8306b639-6a82-4a55-82b0-8b0d6b7ecf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-809764783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da4f723-9fc5-4604-8b2b-859d006eaa4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bcb7246ecc3474aad329627480071bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:52Z,use_quota=True,user_id='e9b5c92ac16340cf854be7729fa0fe79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d69c4cf7-43c9-496d-826b-e5d7c23855cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:52 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:10:52 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d69c4cf7-43c9-496d-826b-e5d7c23855cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0240bc25-ce6c-4ad5-8e66-60ede55c0965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0240bc25-ce6c-4ad5-8e66-60ede55c0965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7da4f723-9fc5-4604-8b2b-859d006eaa4b', 'volume_name': 'volume-7da4f723-9fc5-4604-8b2b-859d006eaa4b', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60605622-5bb8-4f0d-a074-da7b3894346a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60605622-5bb8-4f0d-a074-da7b3894346a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5162ff0d-423a-4277-a9c8-81b33d76d235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:52 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Volume 7da4f723-9fc5-4604-8b2b-859d006eaa4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7da4f723-9fc5-4604-8b2b-859d006eaa4b', 'volume_size': 1} Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:52 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d12e0cbd-b4ef-4105-9652-6c25ade52988 1073741824" returned: 0 in 0.724s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d12e0cbd-b4ef-4105-9652-6c25ade52988 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:52 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d12e0cbd-b4ef-4105-9652-6c25ade52988 Sep 21 12:10:52 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:52 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b3061792-e4af-4160-9c58-c8c316db1d27 tempest-VolumeDependencyTests-1245787338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.307s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-b3061792-e4af-4160-9c58-c8c316db1d27 tempest-VolumeDependencyTests-1245787338 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:10:52 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-b3061792-e4af-4160-9c58-c8c316db1d27 tempest-VolumeDependencyTests-1245787338 None] Deleted volume successfully. Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b3061792-e4af-4160-9c58-c8c316db1d27 tempest-VolumeDependencyTests-1245787338 None] Lock "cinder-c80f58fa-97ae-4061-8e8b-80c491a605aa-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:52 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d12e0cbd-b4ef-4105-9652-6c25ade52988" returned: 0 in 0.277s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.318s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-524345988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4d9572-47b6-4ea0-9ad3-207253cbc024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bcb7246ecc3474aad329627480071bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:50Z,use_quota=True,user_id='e9b5c92ac16340cf854be7729fa0fe79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Creating volume ba4d9572-47b6-4ea0-9ad3-207253cbc024 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:10:52 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ba4d9572-47b6-4ea0-9ad3-207253cbc024 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c37aa3-d8df-43e4-9182-2fb62c3d6408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d12e0cbd-b4ef-4105-9652-6c25ade52988', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea43d8e-7080-46c9-a2e2-ada3eeb1199a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:52 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ba4d9572-47b6-4ea0-9ad3-207253cbc024 1073741824 Sep 21 12:10:52 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:52 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Volume volume-d12e0cbd-b4ef-4105-9652-6c25ade52988 (d12e0cbd-b4ef-4105-9652-6c25ade52988): created successfully Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea43d8e-7080-46c9-a2e2-ada3eeb1199a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Flow 'volume_create_manager' (de8ee950-f4c8-462f-96a7-3f96d1a2731c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:52 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-fb507a6d-3d4b-48c6-a601-43ed2e2f5a25 tempest-CreateVolumesFromImageTest-1024786921 None] Created volume successfully. Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-425ee3c0-db30-4e1d-af3f-b874e9f6b17d tempest-ProjectReaderTests-260641808 None] Acquiring lock "cinder-90b099f7-c212-4fdb-b5c7-9a8195c1dab9-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:52 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-425ee3c0-db30-4e1d-af3f-b874e9f6b17d tempest-ProjectReaderTests-260641808 None] Lock "cinder-90b099f7-c212-4fdb-b5c7-9a8195c1dab9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-425ee3c0-db30-4e1d-af3f-b874e9f6b17d tempest-ProjectReaderTests-260641808 None] Acquiring lock "cinder-quobyte-90b099f7-c212-4fdb-b5c7-9a8195c1dab9" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-425ee3c0-db30-4e1d-af3f-b874e9f6b17d tempest-ProjectReaderTests-260641808 None] Lock "cinder-quobyte-90b099f7-c212-4fdb-b5c7-9a8195c1dab9" acquired by "delete_volume" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:53 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8c73f4-9806-424f-8929-35980c7b35b0]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:10:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-425ee3c0-db30-4e1d-af3f-b874e9f6b17d tempest-ProjectReaderTests-260641808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90b099f7-c212-4fdb-b5c7-9a8195c1dab9 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:53 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ba4d9572-47b6-4ea0-9ad3-207253cbc024 1073741824" returned: 0 in 0.648s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ba4d9572-47b6-4ea0-9ad3-207253cbc024 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:53 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90b099f7-c212-4fdb-b5c7-9a8195c1dab9 Sep 21 12:10:53 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:53 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ba4d9572-47b6-4ea0-9ad3-207253cbc024 Sep 21 12:10:53 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:53 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ba4d9572-47b6-4ea0-9ad3-207253cbc024" returned: 0 in 0.342s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:53 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:10:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.608s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:53 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-458072712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed66cd1-fa61-4092-b1e5-cd7b588f0120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bcb7246ecc3474aad329627480071bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:51Z,use_quota=True,user_id='e9b5c92ac16340cf854be7729fa0fe79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:10:53 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Creating volume 6ed66cd1-fa61-4092-b1e5-cd7b588f0120 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:10:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:53 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:53 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:53 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:10:53 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:10:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6ed66cd1-fa61-4092-b1e5-cd7b588f0120 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:53 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6ed66cd1-fa61-4092-b1e5-cd7b588f0120 1073741824 Sep 21 12:10:53 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:53 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (877faa95-44fc-45d1-ad87-00eebe0af4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba4d9572-47b6-4ea0-9ad3-207253cbc024', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:53 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:53 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb1d42d-f8e9-46e1-8972-9cc08ae08c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-425ee3c0-db30-4e1d-af3f-b874e9f6b17d tempest-ProjectReaderTests-260641808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90b099f7-c212-4fdb-b5c7-9a8195c1dab9" returned: 0 in 0.540s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-425ee3c0-db30-4e1d-af3f-b874e9f6b17d tempest-ProjectReaderTests-260641808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90b099f7-c212-4fdb-b5c7-9a8195c1dab9 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:53 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Volume volume-ba4d9572-47b6-4ea0-9ad3-207253cbc024 (ba4d9572-47b6-4ea0-9ad3-207253cbc024): created successfully Sep 21 12:10:53 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90b099f7-c212-4fdb-b5c7-9a8195c1dab9 Sep 21 12:10:53 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:53 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb1d42d-f8e9-46e1-8972-9cc08ae08c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:53 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Flow 'volume_create_manager' (262048bb-f725-418d-835a-c2068ce2a36f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:53 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-54f5023e-15ee-48d2-a374-1beff5ba8da9 tempest-CreateVolumesFromImageTest-1024786921 None] Created volume successfully. Sep 21 12:10:53 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-425ee3c0-db30-4e1d-af3f-b874e9f6b17d tempest-ProjectReaderTests-260641808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90b099f7-c212-4fdb-b5c7-9a8195c1dab9" returned: 0 in 0.363s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-425ee3c0-db30-4e1d-af3f-b874e9f6b17d tempest-ProjectReaderTests-260641808 None] Lock "cinder-quobyte-90b099f7-c212-4fdb-b5c7-9a8195c1dab9" released by "delete_volume" :: held 0.953s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-425ee3c0-db30-4e1d-af3f-b874e9f6b17d tempest-ProjectReaderTests-260641808 None] Created reservations ['ef15260b-a057-4dbe-87b3-8ce08992fcba', 'ac046d69-96ae-480f-8fcc-bed1964ac544', 'cf56f160-4a33-49d6-95f1-40082d14b3e1', 'b8545b8c-766e-47a7-995d-4a70c1786769'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-425ee3c0-db30-4e1d-af3f-b874e9f6b17d tempest-ProjectReaderTests-260641808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-425ee3c0-db30-4e1d-af3f-b874e9f6b17d tempest-ProjectReaderTests-260641808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-425ee3c0-db30-4e1d-af3f-b874e9f6b17d tempest-ProjectReaderTests-260641808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-425ee3c0-db30-4e1d-af3f-b874e9f6b17d tempest-ProjectReaderTests-260641808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-425ee3c0-db30-4e1d-af3f-b874e9f6b17d tempest-ProjectReaderTests-260641808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-425ee3c0-db30-4e1d-af3f-b874e9f6b17d tempest-ProjectReaderTests-260641808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:54 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6ed66cd1-fa61-4092-b1e5-cd7b588f0120 1073741824" returned: 0 in 0.670s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:54 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:10:54 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6ed66cd1-fa61-4092-b1e5-cd7b588f0120 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:54 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6ed66cd1-fa61-4092-b1e5-cd7b588f0120 Sep 21 12:10:54 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:54 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-425ee3c0-db30-4e1d-af3f-b874e9f6b17d tempest-ProjectReaderTests-260641808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.375s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-425ee3c0-db30-4e1d-af3f-b874e9f6b17d tempest-ProjectReaderTests-260641808 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:10:54 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-425ee3c0-db30-4e1d-af3f-b874e9f6b17d tempest-ProjectReaderTests-260641808 None] Deleted volume successfully. Sep 21 12:10:54 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6ed66cd1-fa61-4092-b1e5-cd7b588f0120" returned: 0 in 0.327s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.057s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1590214365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f55d58-2c45-4c97-a6f6-041eed2c5edc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bcb7246ecc3474aad329627480071bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:51Z,use_quota=True,user_id='e9b5c92ac16340cf854be7729fa0fe79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Creating volume a2f55d58-2c45-4c97-a6f6-041eed2c5edc {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:10:54 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a2f55d58-2c45-4c97-a6f6-041eed2c5edc 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f952cf9-36e8-47e1-b2dd-1cb28b617aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ed66cd1-fa61-4092-b1e5-cd7b588f0120', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd51faa5-2c84-418e-b905-2e382e5f9fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:54 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a2f55d58-2c45-4c97-a6f6-041eed2c5edc 1073741824 Sep 21 12:10:54 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-425ee3c0-db30-4e1d-af3f-b874e9f6b17d tempest-ProjectReaderTests-260641808 None] Lock "cinder-90b099f7-c212-4fdb-b5c7-9a8195c1dab9-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:54 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Volume volume-6ed66cd1-fa61-4092-b1e5-cd7b588f0120 (6ed66cd1-fa61-4092-b1e5-cd7b588f0120): created successfully Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd51faa5-2c84-418e-b905-2e382e5f9fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:54 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Flow 'volume_create_manager' (19ae68d5-ff32-4a51-8683-4cb9cfa62f66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:54 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-6e089658-9792-4aba-afc3-72ce473fdff9 tempest-CreateVolumesFromImageTest-1024786921 None] Created volume successfully. Sep 21 12:10:55 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a2f55d58-2c45-4c97-a6f6-041eed2c5edc 1073741824" returned: 0 in 0.667s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a2f55d58-2c45-4c97-a6f6-041eed2c5edc {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:55 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a2f55d58-2c45-4c97-a6f6-041eed2c5edc Sep 21 12:10:55 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:55 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a2f55d58-2c45-4c97-a6f6-041eed2c5edc" returned: 0 in 0.426s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:55 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:10:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.734s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:55 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-809764783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da4f723-9fc5-4604-8b2b-859d006eaa4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bcb7246ecc3474aad329627480071bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:52Z,use_quota=True,user_id='e9b5c92ac16340cf854be7729fa0fe79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:10:55 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Creating volume 7da4f723-9fc5-4604-8b2b-859d006eaa4b {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:10:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:55 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:55 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:55 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:10:55 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:10:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7da4f723-9fc5-4604-8b2b-859d006eaa4b 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:55 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e7749f-4ff6-40a8-bbd4-a2d2df9d53a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2f55d58-2c45-4c97-a6f6-041eed2c5edc', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:55 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7da4f723-9fc5-4604-8b2b-859d006eaa4b 1073741824 Sep 21 12:10:55 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:55 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abdae04e-29b6-46b5-860c-1228c140fc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:55 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Volume volume-a2f55d58-2c45-4c97-a6f6-041eed2c5edc (a2f55d58-2c45-4c97-a6f6-041eed2c5edc): created successfully Sep 21 12:10:55 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abdae04e-29b6-46b5-860c-1228c140fc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:55 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Flow 'volume_create_manager' (4b46ebe4-f90f-4a8d-81df-cb3be8496743) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:55 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-c7518f9b-0850-4d36-b841-27d7baf3540a tempest-CreateVolumesFromImageTest-1024786921 None] Created volume successfully. Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Flow 'volume_create_manager' (486e0e64-f1a9-4cfc-869c-5ce48418a39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5c8fb6-5d9e-43e5-8069-90c8900ba397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5c8fb6-5d9e-43e5-8069-90c8900ba397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1331755711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d96886-4860-40d3-828c-34e9a0b772ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64694ba6e3d3478f9a003fd672883afd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:56Z,use_quota=True,user_id='55ba8f0dc9ea451dbd10edd9b5f6a6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f53ac5a-9624-4049-9700-37d0c4ac1596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f53ac5a-9624-4049-9700-37d0c4ac1596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78edeb7-171c-4b82-8c32-4bfde9122134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78edeb7-171c-4b82-8c32-4bfde9122134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5d96886-4860-40d3-828c-34e9a0b772ea', 'volume_name': 'volume-f5d96886-4860-40d3-828c-34e9a0b772ea', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526af459-fd30-4b46-b9a2-601e1b5c4ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526af459-fd30-4b46-b9a2-601e1b5c4ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a6c6460-cf18-486e-873c-ebe91e5d748d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:56 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Volume f5d96886-4860-40d3-828c-34e9a0b772ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5d96886-4860-40d3-828c-34e9a0b772ea', 'volume_size': 1} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Flow 'volume_create_manager' (427bc50e-0bbb-4a81-9013-7ebf940c7fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54dea2b2-8317-46a1-8729-5df9a13958d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54dea2b2-8317-46a1-8729-5df9a13958d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1250062496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08298b2f-f07a-41ee-8b0b-d8bf73a13dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ec89d4ae5974e21be22a3468e9cdc5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:56Z,use_quota=True,user_id='bbb90798e0f84460a37996fc516714da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0e3618-1211-4d34-8c1f-0f1cd26bf436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0e3618-1211-4d34-8c1f-0f1cd26bf436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6222b050-0fab-4e6f-a104-341d21887023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6222b050-0fab-4e6f-a104-341d21887023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08298b2f-f07a-41ee-8b0b-d8bf73a13dfa', 'volume_name': 'volume-08298b2f-f07a-41ee-8b0b-d8bf73a13dfa', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1698b04-896c-4497-b7ae-07aa6dad60de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1698b04-896c-4497-b7ae-07aa6dad60de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cbe476e-a874-4918-adac-fc398f3ab1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:56 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Volume 08298b2f-f07a-41ee-8b0b-d8bf73a13dfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08298b2f-f07a-41ee-8b0b-d8bf73a13dfa', 'volume_size': 1} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:56 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7da4f723-9fc5-4604-8b2b-859d006eaa4b 1073741824" returned: 0 in 0.580s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7da4f723-9fc5-4604-8b2b-859d006eaa4b {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:56 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7da4f723-9fc5-4604-8b2b-859d006eaa4b Sep 21 12:10:56 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:56 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7da4f723-9fc5-4604-8b2b-859d006eaa4b" returned: 0 in 0.277s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.518s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1331755711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d96886-4860-40d3-828c-34e9a0b772ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64694ba6e3d3478f9a003fd672883afd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:56Z,use_quota=True,user_id='55ba8f0dc9ea451dbd10edd9b5f6a6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Creating volume f5d96886-4860-40d3-828c-34e9a0b772ea {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:10:56 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f5d96886-4860-40d3-828c-34e9a0b772ea 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5162ff0d-423a-4277-a9c8-81b33d76d235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7da4f723-9fc5-4604-8b2b-859d006eaa4b', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:56 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f5d96886-4860-40d3-828c-34e9a0b772ea 1073741824 Sep 21 12:10:56 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b0bc3b-fe43-4659-aa14-79877eed9287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:56 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Volume volume-7da4f723-9fc5-4604-8b2b-859d006eaa4b (7da4f723-9fc5-4604-8b2b-859d006eaa4b): created successfully Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b0bc3b-fe43-4659-aa14-79877eed9287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:56 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Flow 'volume_create_manager' (bba9ddd8-1966-41a2-9fea-325eee90d074) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:56 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-852d613f-0cc7-44e0-95a1-9ef5ce359b66 tempest-CreateVolumesFromImageTest-1024786921 None] Created volume successfully. Sep 21 12:10:57 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1a382ffa-4ebc-45b2-a311-38ece117ab4a tempest-CreateVolumesFromImageTest-1024786921 None] Acquiring lock "cinder-7da4f723-9fc5-4604-8b2b-859d006eaa4b-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:57 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1a382ffa-4ebc-45b2-a311-38ece117ab4a tempest-CreateVolumesFromImageTest-1024786921 None] Lock "cinder-7da4f723-9fc5-4604-8b2b-859d006eaa4b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:57 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1a382ffa-4ebc-45b2-a311-38ece117ab4a tempest-CreateVolumesFromImageTest-1024786921 None] Acquiring lock "cinder-quobyte-7da4f723-9fc5-4604-8b2b-859d006eaa4b" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:57 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1a382ffa-4ebc-45b2-a311-38ece117ab4a tempest-CreateVolumesFromImageTest-1024786921 None] Lock "cinder-quobyte-7da4f723-9fc5-4604-8b2b-859d006eaa4b" acquired by "delete_volume" :: waited 0.019s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:57 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[861ee5ce-0e50-4cf3-b986-dcc6fd62de30]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:10:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1a382ffa-4ebc-45b2-a311-38ece117ab4a tempest-CreateVolumesFromImageTest-1024786921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7da4f723-9fc5-4604-8b2b-859d006eaa4b {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:57 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f5d96886-4860-40d3-828c-34e9a0b772ea 1073741824" returned: 0 in 0.577s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:57 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7da4f723-9fc5-4604-8b2b-859d006eaa4b Sep 21 12:10:57 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f5d96886-4860-40d3-828c-34e9a0b772ea {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:57 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f5d96886-4860-40d3-828c-34e9a0b772ea Sep 21 12:10:57 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:57 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f5d96886-4860-40d3-828c-34e9a0b772ea" returned: 0 in 0.310s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:10:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.352s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1250062496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08298b2f-f07a-41ee-8b0b-d8bf73a13dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ec89d4ae5974e21be22a3468e9cdc5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:56Z,use_quota=True,user_id='bbb90798e0f84460a37996fc516714da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:10:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Creating volume 08298b2f-f07a-41ee-8b0b-d8bf73a13dfa {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:10:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:57 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:10:57 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:10:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-08298b2f-f07a-41ee-8b0b-d8bf73a13dfa 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0bf51764-3482-4678-8deb-9cfa4d7034fb tempest-ProjectAdminTests-2046574497 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6625900268555, 'free_capacity_gb': 1775.6625900268555, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86366) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 21 12:10:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1a382ffa-4ebc-45b2-a311-38ece117ab4a tempest-CreateVolumesFromImageTest-1024786921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7da4f723-9fc5-4604-8b2b-859d006eaa4b" returned: 0 in 0.493s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1a382ffa-4ebc-45b2-a311-38ece117ab4a tempest-CreateVolumesFromImageTest-1024786921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7da4f723-9fc5-4604-8b2b-859d006eaa4b {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:57 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-08298b2f-f07a-41ee-8b0b-d8bf73a13dfa 1073741824 Sep 21 12:10:57 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a6c6460-cf18-486e-873c-ebe91e5d748d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5d96886-4860-40d3-828c-34e9a0b772ea', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acc9198d-20b9-445d-b660-d1bc1248a345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:57 devstack sudo[105140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7da4f723-9fc5-4604-8b2b-859d006eaa4b Sep 21 12:10:57 devstack sudo[105140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:57 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Volume volume-f5d96886-4860-40d3-828c-34e9a0b772ea (f5d96886-4860-40d3-828c-34e9a0b772ea): created successfully Sep 21 12:10:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acc9198d-20b9-445d-b660-d1bc1248a345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:57 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Flow 'volume_create_manager' (486e0e64-f1a9-4cfc-869c-5ce48418a39a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:57 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-041dc6a8-1668-4b3f-bdf9-66741a553a07 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Created volume successfully. Sep 21 12:10:58 devstack sudo[105140]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1a382ffa-4ebc-45b2-a311-38ece117ab4a tempest-CreateVolumesFromImageTest-1024786921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7da4f723-9fc5-4604-8b2b-859d006eaa4b" returned: 0 in 0.414s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:58 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1a382ffa-4ebc-45b2-a311-38ece117ab4a tempest-CreateVolumesFromImageTest-1024786921 None] Lock "cinder-quobyte-7da4f723-9fc5-4604-8b2b-859d006eaa4b" released by "delete_volume" :: held 0.968s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:58 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-1a382ffa-4ebc-45b2-a311-38ece117ab4a tempest-CreateVolumesFromImageTest-1024786921 None] Created reservations ['5802c385-b6d8-460f-a061-2ea01134fdd3', '3900787c-2c3a-418e-9648-be302af5a03d', 'f9baab1f-ed5c-48c2-a962-14172e294275', '5c11b5d8-cb97-4690-ab54-37a84e369446'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:10:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1a382ffa-4ebc-45b2-a311-38ece117ab4a tempest-CreateVolumesFromImageTest-1024786921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1a382ffa-4ebc-45b2-a311-38ece117ab4a tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1a382ffa-4ebc-45b2-a311-38ece117ab4a tempest-CreateVolumesFromImageTest-1024786921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1a382ffa-4ebc-45b2-a311-38ece117ab4a tempest-CreateVolumesFromImageTest-1024786921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1a382ffa-4ebc-45b2-a311-38ece117ab4a tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1a382ffa-4ebc-45b2-a311-38ece117ab4a tempest-CreateVolumesFromImageTest-1024786921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:58 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-08298b2f-f07a-41ee-8b0b-d8bf73a13dfa 1073741824" returned: 0 in 0.755s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:58 devstack sudo[105182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:10:58 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-08298b2f-f07a-41ee-8b0b-d8bf73a13dfa {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:58 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-08298b2f-f07a-41ee-8b0b-d8bf73a13dfa Sep 21 12:10:58 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:58 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1a382ffa-4ebc-45b2-a311-38ece117ab4a tempest-CreateVolumesFromImageTest-1024786921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.352s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:58 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-1a382ffa-4ebc-45b2-a311-38ece117ab4a tempest-CreateVolumesFromImageTest-1024786921 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:10:58 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1a382ffa-4ebc-45b2-a311-38ece117ab4a tempest-CreateVolumesFromImageTest-1024786921 None] Deleted volume successfully. Sep 21 12:10:58 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1a382ffa-4ebc-45b2-a311-38ece117ab4a tempest-CreateVolumesFromImageTest-1024786921 None] Lock "cinder-7da4f723-9fc5-4604-8b2b-859d006eaa4b-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:10:58 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:10:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Flow 'volume_create_manager' (e19a6f10-00ab-4723-802e-cb6f84f26de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40f943d-1f6d-4bf3-9afd-96bb1cddb713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40f943d-1f6d-4bf3-9afd-96bb1cddb713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-858403474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfc5e555-096e-4e29-839b-da1d46bb3d63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64694ba6e3d3478f9a003fd672883afd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:59Z,use_quota=True,user_id='55ba8f0dc9ea451dbd10edd9b5f6a6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbb098c5-296a-462d-835e-e78f2386a7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbb098c5-296a-462d-835e-e78f2386a7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a73136-5c61-481e-bb16-3cca3732a27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a73136-5c61-481e-bb16-3cca3732a27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfc5e555-096e-4e29-839b-da1d46bb3d63', 'volume_name': 'volume-cfc5e555-096e-4e29-839b-da1d46bb3d63', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:58 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541243f2-e20d-401e-90fe-056dc63a7a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (541243f2-e20d-401e-90fe-056dc63a7a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51cb3e01-06e8-4955-9e83-1f4416050aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:58 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Volume cfc5e555-096e-4e29-839b-da1d46bb3d63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfc5e555-096e-4e29-839b-da1d46bb3d63', 'volume_size': 1} Sep 21 12:10:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-08298b2f-f07a-41ee-8b0b-d8bf73a13dfa" returned: 0 in 0.519s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-858403474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfc5e555-096e-4e29-839b-da1d46bb3d63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64694ba6e3d3478f9a003fd672883afd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:59Z,use_quota=True,user_id='55ba8f0dc9ea451dbd10edd9b5f6a6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Creating volume cfc5e555-096e-4e29-839b-da1d46bb3d63 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:10:59 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-cfc5e555-096e-4e29-839b-da1d46bb3d63 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cbe476e-a874-4918-adac-fc398f3ab1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08298b2f-f07a-41ee-8b0b-d8bf73a13dfa', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba3ee5e-714f-46ee-9d09-82f352a5e352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:59 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-cfc5e555-096e-4e29-839b-da1d46bb3d63 1073741824 Sep 21 12:10:59 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:59 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Volume volume-08298b2f-f07a-41ee-8b0b-d8bf73a13dfa (08298b2f-f07a-41ee-8b0b-d8bf73a13dfa): created successfully Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba3ee5e-714f-46ee-9d09-82f352a5e352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Flow 'volume_create_manager' (427bc50e-0bbb-4a81-9013-7ebf940c7fe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:59 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-25b4104b-a815-4a9f-9c3f-4989ce7df7ca tempest-ProjectReaderTests-260641808 None] Created volume successfully. Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Flow 'volume_create_manager' (5c15c797-e6ff-42d7-8a1d-87491967b95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048cc079-e146-46c0-99e3-ff5de38f1e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048cc079-e146-46c0-99e3-ff5de38f1e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1989860048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9800d174-592f-4efc-bc64-bbb925ae1956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64694ba6e3d3478f9a003fd672883afd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:59Z,use_quota=True,user_id='55ba8f0dc9ea451dbd10edd9b5f6a6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d470137-e267-4532-ab5e-b00ee7b354eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d470137-e267-4532-ab5e-b00ee7b354eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e88b3b-987b-4325-9869-ae8e89c72b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e88b3b-987b-4325-9869-ae8e89c72b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9800d174-592f-4efc-bc64-bbb925ae1956', 'volume_name': 'volume-9800d174-592f-4efc-bc64-bbb925ae1956', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d715378-5165-43cd-890f-fd6e6befa9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d715378-5165-43cd-890f-fd6e6befa9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e2ae1b-7356-4308-8497-4232249a6f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:10:59 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Volume 9800d174-592f-4efc-bc64-bbb925ae1956: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9800d174-592f-4efc-bc64-bbb925ae1956', 'volume_size': 1} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-86ec07e6-706b-45bb-947c-71f73effb71b tempest-CreateVolumesFromImageTest-1024786921 None] Acquiring lock "cinder-a2f55d58-2c45-4c97-a6f6-041eed2c5edc-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-86ec07e6-706b-45bb-947c-71f73effb71b tempest-CreateVolumesFromImageTest-1024786921 None] Lock "cinder-a2f55d58-2c45-4c97-a6f6-041eed2c5edc-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-86ec07e6-706b-45bb-947c-71f73effb71b tempest-CreateVolumesFromImageTest-1024786921 None] Acquiring lock "cinder-quobyte-a2f55d58-2c45-4c97-a6f6-041eed2c5edc" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-86ec07e6-706b-45bb-947c-71f73effb71b tempest-CreateVolumesFromImageTest-1024786921 None] Lock "cinder-quobyte-a2f55d58-2c45-4c97-a6f6-041eed2c5edc" acquired by "delete_volume" :: waited 0.030s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7d285a-7532-43a4-832e-f8e905abbb71]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-86ec07e6-706b-45bb-947c-71f73effb71b tempest-CreateVolumesFromImageTest-1024786921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a2f55d58-2c45-4c97-a6f6-041eed2c5edc {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:59 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-cfc5e555-096e-4e29-839b-da1d46bb3d63 1073741824" returned: 0 in 0.706s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:10:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-cfc5e555-096e-4e29-839b-da1d46bb3d63 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:10:59 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-cfc5e555-096e-4e29-839b-da1d46bb3d63 Sep 21 12:10:59 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:10:59 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a2f55d58-2c45-4c97-a6f6-041eed2c5edc Sep 21 12:10:59 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:00 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-cfc5e555-096e-4e29-839b-da1d46bb3d63" returned: 0 in 0.536s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.817s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1989860048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9800d174-592f-4efc-bc64-bbb925ae1956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64694ba6e3d3478f9a003fd672883afd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:10:59Z,use_quota=True,user_id='55ba8f0dc9ea451dbd10edd9b5f6a6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Creating volume 9800d174-592f-4efc-bc64-bbb925ae1956 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:11:00 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9800d174-592f-4efc-bc64-bbb925ae1956 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51cb3e01-06e8-4955-9e83-1f4416050aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfc5e555-096e-4e29-839b-da1d46bb3d63', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb77a3e4-6f02-4825-b4bb-ce287955b962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:11:00 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9800d174-592f-4efc-bc64-bbb925ae1956 1073741824 Sep 21 12:11:00 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Flow 'volume_create_manager' (7fc7b72d-22a0-4884-b00c-a94a06dc9312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:00 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84aa358f-3daf-4613-9f9b-2ac14b965ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-86ec07e6-706b-45bb-947c-71f73effb71b tempest-CreateVolumesFromImageTest-1024786921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a2f55d58-2c45-4c97-a6f6-041eed2c5edc" returned: 0 in 0.786s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-86ec07e6-706b-45bb-947c-71f73effb71b tempest-CreateVolumesFromImageTest-1024786921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a2f55d58-2c45-4c97-a6f6-041eed2c5edc {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84aa358f-3daf-4613-9f9b-2ac14b965ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1557926561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56bb6c10-fdca-4b74-b907-c4627a5cf8c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64694ba6e3d3478f9a003fd672883afd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:00Z,use_quota=True,user_id='55ba8f0dc9ea451dbd10edd9b5f6a6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc752ab2-2b0f-4aec-9ab7-c554fb99acf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:00 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a2f55d58-2c45-4c97-a6f6-041eed2c5edc Sep 21 12:11:00 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc752ab2-2b0f-4aec-9ab7-c554fb99acf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0723a2a3-a036-4719-8fb4-e6895c5c55d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0723a2a3-a036-4719-8fb4-e6895c5c55d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56bb6c10-fdca-4b74-b907-c4627a5cf8c5', 'volume_name': 'volume-56bb6c10-fdca-4b74-b907-c4627a5cf8c5', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f054ae93-e529-4052-8f5f-cb79da625b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f054ae93-e529-4052-8f5f-cb79da625b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f25f331-5257-49af-aa47-06f02c486981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:00 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Volume 56bb6c10-fdca-4b74-b907-c4627a5cf8c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56bb6c10-fdca-4b74-b907-c4627a5cf8c5', 'volume_size': 1} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:00 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Volume volume-cfc5e555-096e-4e29-839b-da1d46bb3d63 (cfc5e555-096e-4e29-839b-da1d46bb3d63): created successfully Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb77a3e4-6f02-4825-b4bb-ce287955b962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Flow 'volume_create_manager' (e19a6f10-00ab-4723-802e-cb6f84f26de5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b051b34a-7e24-4f2b-b784-4c1b0046d010 tempest-ProjectReaderTests-260641808 None] Acquiring lock "cinder-08298b2f-f07a-41ee-8b0b-d8bf73a13dfa-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:00 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-abcd6f9c-1909-4d58-a72a-c61b3518d010 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Created volume successfully. Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b051b34a-7e24-4f2b-b784-4c1b0046d010 tempest-ProjectReaderTests-260641808 None] Lock "cinder-08298b2f-f07a-41ee-8b0b-d8bf73a13dfa-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b051b34a-7e24-4f2b-b784-4c1b0046d010 tempest-ProjectReaderTests-260641808 None] Acquiring lock "cinder-quobyte-08298b2f-f07a-41ee-8b0b-d8bf73a13dfa" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b051b34a-7e24-4f2b-b784-4c1b0046d010 tempest-ProjectReaderTests-260641808 None] Lock "cinder-quobyte-08298b2f-f07a-41ee-8b0b-d8bf73a13dfa" acquired by "delete_volume" :: waited 0.030s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[4836bc62-ca7f-4933-973b-f7026f3eb7d5]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b051b34a-7e24-4f2b-b784-4c1b0046d010 tempest-ProjectReaderTests-260641808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-08298b2f-f07a-41ee-8b0b-d8bf73a13dfa {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:11:01 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Flow 'volume_create_manager' (3c439f8c-2002-48dc-af56-e6f0c080f438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55972fab-e7ae-4f02-abc6-cfd9d3105e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-86ec07e6-706b-45bb-947c-71f73effb71b tempest-CreateVolumesFromImageTest-1024786921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-a2f55d58-2c45-4c97-a6f6-041eed2c5edc" returned: 0 in 0.699s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:01 devstack sudo[105218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-08298b2f-f07a-41ee-8b0b-d8bf73a13dfa Sep 21 12:11:01 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:01 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55972fab-e7ae-4f02-abc6-cfd9d3105e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1361379865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65693047-3e2b-453d-8f81-6a7f8869d1c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64694ba6e3d3478f9a003fd672883afd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:01Z,use_quota=True,user_id='55ba8f0dc9ea451dbd10edd9b5f6a6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ffaa01-6ef2-4f41-acad-8c599dd3399c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ffaa01-6ef2-4f41-acad-8c599dd3399c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af629f2d-f861-40ce-89ab-0c824872526e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af629f2d-f861-40ce-89ab-0c824872526e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65693047-3e2b-453d-8f81-6a7f8869d1c3', 'volume_name': 'volume-65693047-3e2b-453d-8f81-6a7f8869d1c3', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9988ddd5-5c1a-4512-b5cd-44b0b308e4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9988ddd5-5c1a-4512-b5cd-44b0b308e4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (191cacb9-76af-4894-bb9a-080ecc54af5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:01 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Volume 65693047-3e2b-453d-8f81-6a7f8869d1c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65693047-3e2b-453d-8f81-6a7f8869d1c3', 'volume_size': 1} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-86ec07e6-706b-45bb-947c-71f73effb71b tempest-CreateVolumesFromImageTest-1024786921 None] Lock "cinder-quobyte-a2f55d58-2c45-4c97-a6f6-041eed2c5edc" released by "delete_volume" :: held 1.615s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9800d174-592f-4efc-bc64-bbb925ae1956 1073741824" returned: 0 in 0.921s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9800d174-592f-4efc-bc64-bbb925ae1956 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:01 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9800d174-592f-4efc-bc64-bbb925ae1956 Sep 21 12:11:01 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-86ec07e6-706b-45bb-947c-71f73effb71b tempest-CreateVolumesFromImageTest-1024786921 None] Created reservations ['9e1f2f03-bdc5-4c82-ae3f-5ecc1c4d01d6', 'e8412c2b-40ac-459e-95c3-6fecd6b8b145', 'f8ee79bf-4230-443a-9c8c-c92f2ea31e41', '391b37ce-6df2-43bb-ad4e-c44380ba4993'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-86ec07e6-706b-45bb-947c-71f73effb71b tempest-CreateVolumesFromImageTest-1024786921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-86ec07e6-706b-45bb-947c-71f73effb71b tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-86ec07e6-706b-45bb-947c-71f73effb71b tempest-CreateVolumesFromImageTest-1024786921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-86ec07e6-706b-45bb-947c-71f73effb71b tempest-CreateVolumesFromImageTest-1024786921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-86ec07e6-706b-45bb-947c-71f73effb71b tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-86ec07e6-706b-45bb-947c-71f73effb71b tempest-CreateVolumesFromImageTest-1024786921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:01 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:11:01 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:01 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b051b34a-7e24-4f2b-b784-4c1b0046d010 tempest-ProjectReaderTests-260641808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-08298b2f-f07a-41ee-8b0b-d8bf73a13dfa" returned: 0 in 0.691s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b051b34a-7e24-4f2b-b784-4c1b0046d010 tempest-ProjectReaderTests-260641808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-08298b2f-f07a-41ee-8b0b-d8bf73a13dfa {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:01 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9800d174-592f-4efc-bc64-bbb925ae1956" returned: 0 in 0.384s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.086s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1557926561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56bb6c10-fdca-4b74-b907-c4627a5cf8c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64694ba6e3d3478f9a003fd672883afd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:00Z,use_quota=True,user_id='55ba8f0dc9ea451dbd10edd9b5f6a6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Creating volume 56bb6c10-fdca-4b74-b907-c4627a5cf8c5 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:01 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-08298b2f-f07a-41ee-8b0b-d8bf73a13dfa Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:11:01 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:11:01 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-56bb6c10-fdca-4b74-b907-c4627a5cf8c5 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35e2ae1b-7356-4308-8497-4232249a6f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9800d174-592f-4efc-bc64-bbb925ae1956', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e5d6f8a-c0f5-4228-8b9a-4f4b44e7bcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:01 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-56bb6c10-fdca-4b74-b907-c4627a5cf8c5 1073741824 Sep 21 12:11:01 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:01 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Volume volume-9800d174-592f-4efc-bc64-bbb925ae1956 (9800d174-592f-4efc-bc64-bbb925ae1956): created successfully Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e5d6f8a-c0f5-4228-8b9a-4f4b44e7bcf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Flow 'volume_create_manager' (5c15c797-e6ff-42d7-8a1d-87491967b95e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Flow 'volume_create_manager' (de127338-7118-4c47-b22a-dd5869bc21dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dcf2bc5-e2fb-4b75-b51f-c14441d215ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:01 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-80ef1e47-c40e-4f4f-9c08-44ccd7998680 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Created volume successfully. Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dcf2bc5-e2fb-4b75-b51f-c14441d215ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-77754705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=956dfe3c-f921-4e6c-b26f-c310b7d03501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64694ba6e3d3478f9a003fd672883afd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:02Z,use_quota=True,user_id='55ba8f0dc9ea451dbd10edd9b5f6a6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9caf31-3c94-4606-ad11-6a0f4be335e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9caf31-3c94-4606-ad11-6a0f4be335e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97486b43-2d53-4b8c-96e6-036345f72c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97486b43-2d53-4b8c-96e6-036345f72c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '956dfe3c-f921-4e6c-b26f-c310b7d03501', 'volume_name': 'volume-956dfe3c-f921-4e6c-b26f-c310b7d03501', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc1dec88-9505-4a53-8384-7111f43ea6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc1dec88-9505-4a53-8384-7111f43ea6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4aa868c-c4b6-4649-94d9-d45f7c49d924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:02 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Volume 956dfe3c-f921-4e6c-b26f-c310b7d03501: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-956dfe3c-f921-4e6c-b26f-c310b7d03501', 'volume_size': 1} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3625f7b7-3713-4e58-9882-acc80a85708e tempest-CreateVolumesFromImageTest-1024786921 None] Acquiring lock "cinder-6ed66cd1-fa61-4092-b1e5-cd7b588f0120-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:02 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-86ec07e6-706b-45bb-947c-71f73effb71b tempest-CreateVolumesFromImageTest-1024786921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.427s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-86ec07e6-706b-45bb-947c-71f73effb71b tempest-CreateVolumesFromImageTest-1024786921 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:11:02 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-86ec07e6-706b-45bb-947c-71f73effb71b tempest-CreateVolumesFromImageTest-1024786921 None] Deleted volume successfully. Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3625f7b7-3713-4e58-9882-acc80a85708e tempest-CreateVolumesFromImageTest-1024786921 None] Lock "cinder-6ed66cd1-fa61-4092-b1e5-cd7b588f0120-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-86ec07e6-706b-45bb-947c-71f73effb71b tempest-CreateVolumesFromImageTest-1024786921 None] Lock "cinder-a2f55d58-2c45-4c97-a6f6-041eed2c5edc-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3625f7b7-3713-4e58-9882-acc80a85708e tempest-CreateVolumesFromImageTest-1024786921 None] Acquiring lock "cinder-quobyte-6ed66cd1-fa61-4092-b1e5-cd7b588f0120" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3625f7b7-3713-4e58-9882-acc80a85708e tempest-CreateVolumesFromImageTest-1024786921 None] Lock "cinder-quobyte-6ed66cd1-fa61-4092-b1e5-cd7b588f0120" acquired by "delete_volume" :: waited 0.019s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:02 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b051b34a-7e24-4f2b-b784-4c1b0046d010 tempest-ProjectReaderTests-260641808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-08298b2f-f07a-41ee-8b0b-d8bf73a13dfa" returned: 0 in 0.476s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff9351a-d41a-4ba2-be99-3beb3702fed1]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3625f7b7-3713-4e58-9882-acc80a85708e tempest-CreateVolumesFromImageTest-1024786921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6ed66cd1-fa61-4092-b1e5-cd7b588f0120 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b051b34a-7e24-4f2b-b784-4c1b0046d010 tempest-ProjectReaderTests-260641808 None] Lock "cinder-quobyte-08298b2f-f07a-41ee-8b0b-d8bf73a13dfa" released by "delete_volume" :: held 1.250s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-b051b34a-7e24-4f2b-b784-4c1b0046d010 tempest-ProjectReaderTests-260641808 None] Created reservations ['8039074b-90dd-4efa-9d9e-398521e3cc31', 'aa63105b-9f69-4ecb-91a2-7300e1b4e52e', 'ccc28062-d791-412a-9f2e-51e79c3b1300', '9dc7623b-f1e6-4510-a710-899e2c9daa88'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:02 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6ed66cd1-fa61-4092-b1e5-cd7b588f0120 Sep 21 12:11:02 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b051b34a-7e24-4f2b-b784-4c1b0046d010 tempest-ProjectReaderTests-260641808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b051b34a-7e24-4f2b-b784-4c1b0046d010 tempest-ProjectReaderTests-260641808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b051b34a-7e24-4f2b-b784-4c1b0046d010 tempest-ProjectReaderTests-260641808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b051b34a-7e24-4f2b-b784-4c1b0046d010 tempest-ProjectReaderTests-260641808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b051b34a-7e24-4f2b-b784-4c1b0046d010 tempest-ProjectReaderTests-260641808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b051b34a-7e24-4f2b-b784-4c1b0046d010 tempest-ProjectReaderTests-260641808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:02 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:11:02 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:02 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-56bb6c10-fdca-4b74-b907-c4627a5cf8c5 1073741824" returned: 0 in 0.639s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-56bb6c10-fdca-4b74-b907-c4627a5cf8c5 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:02 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-56bb6c10-fdca-4b74-b907-c4627a5cf8c5 Sep 21 12:11:02 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:02 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3625f7b7-3713-4e58-9882-acc80a85708e tempest-CreateVolumesFromImageTest-1024786921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6ed66cd1-fa61-4092-b1e5-cd7b588f0120" returned: 0 in 0.433s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3625f7b7-3713-4e58-9882-acc80a85708e tempest-CreateVolumesFromImageTest-1024786921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6ed66cd1-fa61-4092-b1e5-cd7b588f0120 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:02 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b051b34a-7e24-4f2b-b784-4c1b0046d010 tempest-ProjectReaderTests-260641808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.287s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-b051b34a-7e24-4f2b-b784-4c1b0046d010 tempest-ProjectReaderTests-260641808 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:11:02 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-b051b34a-7e24-4f2b-b784-4c1b0046d010 tempest-ProjectReaderTests-260641808 None] Deleted volume successfully. Sep 21 12:11:02 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6ed66cd1-fa61-4092-b1e5-cd7b588f0120 Sep 21 12:11:02 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b051b34a-7e24-4f2b-b784-4c1b0046d010 tempest-ProjectReaderTests-260641808 None] Lock "cinder-08298b2f-f07a-41ee-8b0b-d8bf73a13dfa-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:02 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-56bb6c10-fdca-4b74-b907-c4627a5cf8c5" returned: 0 in 0.311s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.523s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1361379865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65693047-3e2b-453d-8f81-6a7f8869d1c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64694ba6e3d3478f9a003fd672883afd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:01Z,use_quota=True,user_id='55ba8f0dc9ea451dbd10edd9b5f6a6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Creating volume 65693047-3e2b-453d-8f81-6a7f8869d1c3 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:11:02 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-65693047-3e2b-453d-8f81-6a7f8869d1c3 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f25f331-5257-49af-aa47-06f02c486981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56bb6c10-fdca-4b74-b907-c4627a5cf8c5', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:02 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-65693047-3e2b-453d-8f81-6a7f8869d1c3 1073741824 Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc3ce6b9-6d1d-4c5f-ac31-27fe7abc35ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:02 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:02 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Volume volume-56bb6c10-fdca-4b74-b907-c4627a5cf8c5 (56bb6c10-fdca-4b74-b907-c4627a5cf8c5): created successfully Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc3ce6b9-6d1d-4c5f-ac31-27fe7abc35ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Flow 'volume_create_manager' (7fc7b72d-22a0-4884-b00c-a94a06dc9312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:02 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1168f480-2b25-421e-b504-c72f22cf4a10 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Created volume successfully. Sep 21 12:11:02 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3625f7b7-3713-4e58-9882-acc80a85708e tempest-CreateVolumesFromImageTest-1024786921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-6ed66cd1-fa61-4092-b1e5-cd7b588f0120" returned: 0 in 0.336s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:02 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3625f7b7-3713-4e58-9882-acc80a85708e tempest-CreateVolumesFromImageTest-1024786921 None] Lock "cinder-quobyte-6ed66cd1-fa61-4092-b1e5-cd7b588f0120" released by "delete_volume" :: held 0.825s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:03 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-3625f7b7-3713-4e58-9882-acc80a85708e tempest-CreateVolumesFromImageTest-1024786921 None] Created reservations ['fddef0db-a211-47c1-983c-30a6551ca970', 'bcdb9c66-4118-4152-acb0-c8d1c49fcb1b', '5d1acc2a-cabf-4db0-b518-bb81e74ae9f9', '196bcc78-45ee-4bd6-862a-a4320885cf8c'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3625f7b7-3713-4e58-9882-acc80a85708e tempest-CreateVolumesFromImageTest-1024786921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3625f7b7-3713-4e58-9882-acc80a85708e tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3625f7b7-3713-4e58-9882-acc80a85708e tempest-CreateVolumesFromImageTest-1024786921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3625f7b7-3713-4e58-9882-acc80a85708e tempest-CreateVolumesFromImageTest-1024786921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3625f7b7-3713-4e58-9882-acc80a85708e tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3625f7b7-3713-4e58-9882-acc80a85708e tempest-CreateVolumesFromImageTest-1024786921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:03 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:11:03 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:03 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-aae12cc5-a808-43c0-8a8a-8ba88e7f8ed0 tempest-CreateVolumesFromImageTest-1024786921 None] Acquiring lock "cinder-ba4d9572-47b6-4ea0-9ad3-207253cbc024-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:03 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-aae12cc5-a808-43c0-8a8a-8ba88e7f8ed0 tempest-CreateVolumesFromImageTest-1024786921 None] Lock "cinder-ba4d9572-47b6-4ea0-9ad3-207253cbc024-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:03 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-aae12cc5-a808-43c0-8a8a-8ba88e7f8ed0 tempest-CreateVolumesFromImageTest-1024786921 None] Acquiring lock "cinder-quobyte-ba4d9572-47b6-4ea0-9ad3-207253cbc024" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:03 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-aae12cc5-a808-43c0-8a8a-8ba88e7f8ed0 tempest-CreateVolumesFromImageTest-1024786921 None] Lock "cinder-quobyte-ba4d9572-47b6-4ea0-9ad3-207253cbc024" acquired by "delete_volume" :: waited 0.043s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:03 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-65693047-3e2b-453d-8f81-6a7f8869d1c3 1073741824" returned: 0 in 0.719s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:03 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[7092f515-13f8-414f-8e9c-de641bc46203]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-aae12cc5-a808-43c0-8a8a-8ba88e7f8ed0 tempest-CreateVolumesFromImageTest-1024786921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ba4d9572-47b6-4ea0-9ad3-207253cbc024 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-65693047-3e2b-453d-8f81-6a7f8869d1c3 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:03 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3625f7b7-3713-4e58-9882-acc80a85708e tempest-CreateVolumesFromImageTest-1024786921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.484s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:03 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-3625f7b7-3713-4e58-9882-acc80a85708e tempest-CreateVolumesFromImageTest-1024786921 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:11:03 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-3625f7b7-3713-4e58-9882-acc80a85708e tempest-CreateVolumesFromImageTest-1024786921 None] Deleted volume successfully. Sep 21 12:11:03 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-65693047-3e2b-453d-8f81-6a7f8869d1c3 Sep 21 12:11:03 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:03 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3625f7b7-3713-4e58-9882-acc80a85708e tempest-CreateVolumesFromImageTest-1024786921 None] Lock "cinder-6ed66cd1-fa61-4092-b1e5-cd7b588f0120-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:03 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 12:11:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:03 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ba4d9572-47b6-4ea0-9ad3-207253cbc024 Sep 21 12:11:03 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:03 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:11:03 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:03 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-65693047-3e2b-453d-8f81-6a7f8869d1c3" returned: 0 in 0.392s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.975s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-77754705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=956dfe3c-f921-4e6c-b26f-c310b7d03501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64694ba6e3d3478f9a003fd672883afd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:02Z,use_quota=True,user_id='55ba8f0dc9ea451dbd10edd9b5f6a6c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Creating volume 956dfe3c-f921-4e6c-b26f-c310b7d03501 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:11:04 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-956dfe3c-f921-4e6c-b26f-c310b7d03501 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (191cacb9-76af-4894-bb9a-080ecc54af5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65693047-3e2b-453d-8f81-6a7f8869d1c3', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eac4282-c8f7-4585-b8f6-855349a11973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:04 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-956dfe3c-f921-4e6c-b26f-c310b7d03501 1073741824 Sep 21 12:11:04 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:04 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Volume volume-65693047-3e2b-453d-8f81-6a7f8869d1c3 (65693047-3e2b-453d-8f81-6a7f8869d1c3): created successfully Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eac4282-c8f7-4585-b8f6-855349a11973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Flow 'volume_create_manager' (3c439f8c-2002-48dc-af56-e6f0c080f438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:04 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.391s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:11:04 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-50273635-cb5d-4de3-885e-d3935bfb7dbe tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Created volume successfully. Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread count: 28 {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread info: [<_MainThread(MainThread, started 132841976594560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 12:11:04 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-aae12cc5-a808-43c0-8a8a-8ba88e7f8ed0 tempest-CreateVolumesFromImageTest-1024786921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ba4d9572-47b6-4ea0-9ad3-207253cbc024" returned: 0 in 0.639s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-aae12cc5-a808-43c0-8a8a-8ba88e7f8ed0 tempest-CreateVolumesFromImageTest-1024786921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ba4d9572-47b6-4ea0-9ad3-207253cbc024 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:04 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ba4d9572-47b6-4ea0-9ad3-207253cbc024 Sep 21 12:11:04 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:04 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-aae12cc5-a808-43c0-8a8a-8ba88e7f8ed0 tempest-CreateVolumesFromImageTest-1024786921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-ba4d9572-47b6-4ea0-9ad3-207253cbc024" returned: 0 in 0.314s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-aae12cc5-a808-43c0-8a8a-8ba88e7f8ed0 tempest-CreateVolumesFromImageTest-1024786921 None] Lock "cinder-quobyte-ba4d9572-47b6-4ea0-9ad3-207253cbc024" released by "delete_volume" :: held 1.048s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-aae12cc5-a808-43c0-8a8a-8ba88e7f8ed0 tempest-CreateVolumesFromImageTest-1024786921 None] Created reservations ['97e1d0e5-4db9-4072-87a4-8b0ecab215d7', 'd5fe125a-c1b9-4277-b777-5bced1b86858', '0f9e9bbc-ac72-4ba3-a54b-a8576d41fa81', '1770d5a1-bec3-4c58-865b-51de9b1f886c'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:04 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-956dfe3c-f921-4e6c-b26f-c310b7d03501 1073741824" returned: 0 in 0.582s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-956dfe3c-f921-4e6c-b26f-c310b7d03501 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:04 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-956dfe3c-f921-4e6c-b26f-c310b7d03501 Sep 21 12:11:04 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-aae12cc5-a808-43c0-8a8a-8ba88e7f8ed0 tempest-CreateVolumesFromImageTest-1024786921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-aae12cc5-a808-43c0-8a8a-8ba88e7f8ed0 tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-aae12cc5-a808-43c0-8a8a-8ba88e7f8ed0 tempest-CreateVolumesFromImageTest-1024786921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-aae12cc5-a808-43c0-8a8a-8ba88e7f8ed0 tempest-CreateVolumesFromImageTest-1024786921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-aae12cc5-a808-43c0-8a8a-8ba88e7f8ed0 tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-aae12cc5-a808-43c0-8a8a-8ba88e7f8ed0 tempest-CreateVolumesFromImageTest-1024786921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:04 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:11:04 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:04 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-956dfe3c-f921-4e6c-b26f-c310b7d03501" returned: 0 in 0.295s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4aa868c-c4b6-4649-94d9-d45f7c49d924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-956dfe3c-f921-4e6c-b26f-c310b7d03501', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd321585-4b38-4a7c-9a74-b9e17242ae51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:05 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Volume volume-956dfe3c-f921-4e6c-b26f-c310b7d03501 (956dfe3c-f921-4e6c-b26f-c310b7d03501): created successfully Sep 21 12:11:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd321585-4b38-4a7c-9a74-b9e17242ae51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:05 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Flow 'volume_create_manager' (de127338-7118-4c47-b22a-dd5869bc21dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:05 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-aae12cc5-a808-43c0-8a8a-8ba88e7f8ed0 tempest-CreateVolumesFromImageTest-1024786921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.313s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:05 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-aae12cc5-a808-43c0-8a8a-8ba88e7f8ed0 tempest-CreateVolumesFromImageTest-1024786921 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:11:05 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-05617bbe-d962-4d97-9522-f5e960be8b8b tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Created volume successfully. Sep 21 12:11:05 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-aae12cc5-a808-43c0-8a8a-8ba88e7f8ed0 tempest-CreateVolumesFromImageTest-1024786921 None] Deleted volume successfully. Sep 21 12:11:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-aae12cc5-a808-43c0-8a8a-8ba88e7f8ed0 tempest-CreateVolumesFromImageTest-1024786921 None] Lock "cinder-ba4d9572-47b6-4ea0-9ad3-207253cbc024-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fc98189c-8771-4ca8-b2dc-c27ef280ab9d tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "cinder-956dfe3c-f921-4e6c-b26f-c310b7d03501-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fc98189c-8771-4ca8-b2dc-c27ef280ab9d tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "cinder-956dfe3c-f921-4e6c-b26f-c310b7d03501-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fc98189c-8771-4ca8-b2dc-c27ef280ab9d tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "cinder-quobyte-956dfe3c-f921-4e6c-b26f-c310b7d03501" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fc98189c-8771-4ca8-b2dc-c27ef280ab9d tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "cinder-quobyte-956dfe3c-f921-4e6c-b26f-c310b7d03501" acquired by "delete_volume" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:05 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d024e4-2156-4eff-a3b4-35b4b7e49ceb]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fc98189c-8771-4ca8-b2dc-c27ef280ab9d tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-956dfe3c-f921-4e6c-b26f-c310b7d03501 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:05 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-956dfe3c-f921-4e6c-b26f-c310b7d03501 Sep 21 12:11:05 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9e06e5cf-7828-4cb9-86f0-dfe5b4755086 tempest-CreateVolumesFromImageTest-1024786921 None] Acquiring lock "cinder-d12e0cbd-b4ef-4105-9652-6c25ade52988-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9e06e5cf-7828-4cb9-86f0-dfe5b4755086 tempest-CreateVolumesFromImageTest-1024786921 None] Lock "cinder-d12e0cbd-b4ef-4105-9652-6c25ade52988-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9e06e5cf-7828-4cb9-86f0-dfe5b4755086 tempest-CreateVolumesFromImageTest-1024786921 None] Acquiring lock "cinder-quobyte-d12e0cbd-b4ef-4105-9652-6c25ade52988" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9e06e5cf-7828-4cb9-86f0-dfe5b4755086 tempest-CreateVolumesFromImageTest-1024786921 None] Lock "cinder-quobyte-d12e0cbd-b4ef-4105-9652-6c25ade52988" acquired by "delete_volume" :: waited 0.038s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:05 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd457837-26b2-4845-a5b7-cc61c3937a93]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9e06e5cf-7828-4cb9-86f0-dfe5b4755086 tempest-CreateVolumesFromImageTest-1024786921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d12e0cbd-b4ef-4105-9652-6c25ade52988 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:05 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fc98189c-8771-4ca8-b2dc-c27ef280ab9d tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-956dfe3c-f921-4e6c-b26f-c310b7d03501" returned: 0 in 0.444s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fc98189c-8771-4ca8-b2dc-c27ef280ab9d tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-956dfe3c-f921-4e6c-b26f-c310b7d03501 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:05 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-956dfe3c-f921-4e6c-b26f-c310b7d03501 Sep 21 12:11:05 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:05 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d12e0cbd-b4ef-4105-9652-6c25ade52988 Sep 21 12:11:05 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:06 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fc98189c-8771-4ca8-b2dc-c27ef280ab9d tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-956dfe3c-f921-4e6c-b26f-c310b7d03501" returned: 0 in 0.269s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fc98189c-8771-4ca8-b2dc-c27ef280ab9d tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "cinder-quobyte-956dfe3c-f921-4e6c-b26f-c310b7d03501" released by "delete_volume" :: held 0.772s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-fc98189c-8771-4ca8-b2dc-c27ef280ab9d tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Created reservations ['b2e69514-84e1-4072-8c3f-38a67491046c', 'f22e47ab-f19c-4f05-9b11-bb2175f82234', '80e2168f-aec7-4f69-80ac-e29f0ef12a86', '3818f303-18b3-4447-9aa3-9d30240ace2a'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:06 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9e06e5cf-7828-4cb9-86f0-dfe5b4755086 tempest-CreateVolumesFromImageTest-1024786921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d12e0cbd-b4ef-4105-9652-6c25ade52988" returned: 0 in 0.471s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9e06e5cf-7828-4cb9-86f0-dfe5b4755086 tempest-CreateVolumesFromImageTest-1024786921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d12e0cbd-b4ef-4105-9652-6c25ade52988 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:06 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d12e0cbd-b4ef-4105-9652-6c25ade52988 Sep 21 12:11:06 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fc98189c-8771-4ca8-b2dc-c27ef280ab9d tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fc98189c-8771-4ca8-b2dc-c27ef280ab9d tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fc98189c-8771-4ca8-b2dc-c27ef280ab9d tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fc98189c-8771-4ca8-b2dc-c27ef280ab9d tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fc98189c-8771-4ca8-b2dc-c27ef280ab9d tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fc98189c-8771-4ca8-b2dc-c27ef280ab9d tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:06 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:11:06 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-d74e586e-cc60-4e83-9bc4-920cedd696eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "cinder-65693047-3e2b-453d-8f81-6a7f8869d1c3-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-d74e586e-cc60-4e83-9bc4-920cedd696eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "cinder-65693047-3e2b-453d-8f81-6a7f8869d1c3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:06 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9e06e5cf-7828-4cb9-86f0-dfe5b4755086 tempest-CreateVolumesFromImageTest-1024786921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d12e0cbd-b4ef-4105-9652-6c25ade52988" returned: 0 in 0.320s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9e06e5cf-7828-4cb9-86f0-dfe5b4755086 tempest-CreateVolumesFromImageTest-1024786921 None] Lock "cinder-quobyte-d12e0cbd-b4ef-4105-9652-6c25ade52988" released by "delete_volume" :: held 0.861s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-d74e586e-cc60-4e83-9bc4-920cedd696eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "cinder-quobyte-65693047-3e2b-453d-8f81-6a7f8869d1c3" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-d74e586e-cc60-4e83-9bc4-920cedd696eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "cinder-quobyte-65693047-3e2b-453d-8f81-6a7f8869d1c3" acquired by "delete_volume" :: waited 0.021s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:06 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19c0338-6350-4bb4-acfb-8827eff85422]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d74e586e-cc60-4e83-9bc4-920cedd696eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-65693047-3e2b-453d-8f81-6a7f8869d1c3 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fc98189c-8771-4ca8-b2dc-c27ef280ab9d tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.357s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-fc98189c-8771-4ca8-b2dc-c27ef280ab9d tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:11:06 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-fc98189c-8771-4ca8-b2dc-c27ef280ab9d tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Deleted volume successfully. Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-9e06e5cf-7828-4cb9-86f0-dfe5b4755086 tempest-CreateVolumesFromImageTest-1024786921 None] Created reservations ['efceb9b9-1b1b-4233-ba7b-fd23e164bcb5', 'cd71ff07-bc7b-483e-92ee-dca787f5a57b', '081a1d65-d956-4045-991a-31e244325f28', '80bfd61d-18c3-44c7-9d23-0af991738358'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fc98189c-8771-4ca8-b2dc-c27ef280ab9d tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "cinder-956dfe3c-f921-4e6c-b26f-c310b7d03501-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9e06e5cf-7828-4cb9-86f0-dfe5b4755086 tempest-CreateVolumesFromImageTest-1024786921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9e06e5cf-7828-4cb9-86f0-dfe5b4755086 tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9e06e5cf-7828-4cb9-86f0-dfe5b4755086 tempest-CreateVolumesFromImageTest-1024786921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:06 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-65693047-3e2b-453d-8f81-6a7f8869d1c3 Sep 21 12:11:06 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9e06e5cf-7828-4cb9-86f0-dfe5b4755086 tempest-CreateVolumesFromImageTest-1024786921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9e06e5cf-7828-4cb9-86f0-dfe5b4755086 tempest-CreateVolumesFromImageTest-1024786921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9e06e5cf-7828-4cb9-86f0-dfe5b4755086 tempest-CreateVolumesFromImageTest-1024786921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:06 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:11:06 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:07 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d74e586e-cc60-4e83-9bc4-920cedd696eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-65693047-3e2b-453d-8f81-6a7f8869d1c3" returned: 0 in 0.513s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d74e586e-cc60-4e83-9bc4-920cedd696eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-65693047-3e2b-453d-8f81-6a7f8869d1c3 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:07 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9e06e5cf-7828-4cb9-86f0-dfe5b4755086 tempest-CreateVolumesFromImageTest-1024786921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.354s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:07 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-9e06e5cf-7828-4cb9-86f0-dfe5b4755086 tempest-CreateVolumesFromImageTest-1024786921 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:11:07 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-9e06e5cf-7828-4cb9-86f0-dfe5b4755086 tempest-CreateVolumesFromImageTest-1024786921 None] Deleted volume successfully. Sep 21 12:11:07 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-65693047-3e2b-453d-8f81-6a7f8869d1c3 Sep 21 12:11:07 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:07 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9e06e5cf-7828-4cb9-86f0-dfe5b4755086 tempest-CreateVolumesFromImageTest-1024786921 None] Lock "cinder-d12e0cbd-b4ef-4105-9652-6c25ade52988-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:07 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d74e586e-cc60-4e83-9bc4-920cedd696eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-65693047-3e2b-453d-8f81-6a7f8869d1c3" returned: 0 in 0.324s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:07 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-d74e586e-cc60-4e83-9bc4-920cedd696eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "cinder-quobyte-65693047-3e2b-453d-8f81-6a7f8869d1c3" released by "delete_volume" :: held 0.892s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:07 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-d74e586e-cc60-4e83-9bc4-920cedd696eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Created reservations ['464f5495-5600-4c7a-a606-6bd2d29fe328', 'ca3ab242-e90c-47b7-9402-3b36dac7c85e', 'c86715c7-8f2f-4845-8f45-e1d5b2636944', '2701ecbe-f243-46dd-85ed-a80bdc03b841'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d74e586e-cc60-4e83-9bc4-920cedd696eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d74e586e-cc60-4e83-9bc4-920cedd696eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d74e586e-cc60-4e83-9bc4-920cedd696eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d74e586e-cc60-4e83-9bc4-920cedd696eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d74e586e-cc60-4e83-9bc4-920cedd696eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d74e586e-cc60-4e83-9bc4-920cedd696eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:07 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:11:07 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:07 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f6a30c9e-788e-4ad8-b30a-6228187903eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "cinder-56bb6c10-fdca-4b74-b907-c4627a5cf8c5-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:07 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f6a30c9e-788e-4ad8-b30a-6228187903eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "cinder-56bb6c10-fdca-4b74-b907-c4627a5cf8c5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:07 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f6a30c9e-788e-4ad8-b30a-6228187903eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "cinder-quobyte-56bb6c10-fdca-4b74-b907-c4627a5cf8c5" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:07 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f6a30c9e-788e-4ad8-b30a-6228187903eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "cinder-quobyte-56bb6c10-fdca-4b74-b907-c4627a5cf8c5" acquired by "delete_volume" :: waited 0.043s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:07 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c14596-65ea-4a6d-8f7a-de19facb44bd]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f6a30c9e-788e-4ad8-b30a-6228187903eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-56bb6c10-fdca-4b74-b907-c4627a5cf8c5 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:08 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d74e586e-cc60-4e83-9bc4-920cedd696eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.410s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:08 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-d74e586e-cc60-4e83-9bc4-920cedd696eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:11:08 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-d74e586e-cc60-4e83-9bc4-920cedd696eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Deleted volume successfully. Sep 21 12:11:08 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-d74e586e-cc60-4e83-9bc4-920cedd696eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "cinder-65693047-3e2b-453d-8f81-6a7f8869d1c3-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:08 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-56bb6c10-fdca-4b74-b907-c4627a5cf8c5 Sep 21 12:11:08 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:08 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f6a30c9e-788e-4ad8-b30a-6228187903eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-56bb6c10-fdca-4b74-b907-c4627a5cf8c5" returned: 0 in 0.484s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f6a30c9e-788e-4ad8-b30a-6228187903eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-56bb6c10-fdca-4b74-b907-c4627a5cf8c5 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:08 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-56bb6c10-fdca-4b74-b907-c4627a5cf8c5 Sep 21 12:11:08 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:08 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f6a30c9e-788e-4ad8-b30a-6228187903eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-56bb6c10-fdca-4b74-b907-c4627a5cf8c5" returned: 0 in 0.342s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:08 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f6a30c9e-788e-4ad8-b30a-6228187903eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "cinder-quobyte-56bb6c10-fdca-4b74-b907-c4627a5cf8c5" released by "delete_volume" :: held 0.925s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:08 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-f6a30c9e-788e-4ad8-b30a-6228187903eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Created reservations ['4d8c80bd-5259-41c0-91f7-30dfb04e1749', 'e8727c54-1a65-4bd9-bbc7-bf6191ca56db', 'c8084137-2354-4d24-99f5-00994a359274', 'a35d7e50-785f-478c-abf6-092c171fd9d8'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f6a30c9e-788e-4ad8-b30a-6228187903eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f6a30c9e-788e-4ad8-b30a-6228187903eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:08 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f6a30c9e-788e-4ad8-b30a-6228187903eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:08 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f6a30c9e-788e-4ad8-b30a-6228187903eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f6a30c9e-788e-4ad8-b30a-6228187903eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f6a30c9e-788e-4ad8-b30a-6228187903eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:09 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:11:09 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:09 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f6a30c9e-788e-4ad8-b30a-6228187903eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.298s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:09 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-f6a30c9e-788e-4ad8-b30a-6228187903eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:11:09 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-f6a30c9e-788e-4ad8-b30a-6228187903eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Deleted volume successfully. Sep 21 12:11:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f6a30c9e-788e-4ad8-b30a-6228187903eb tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "cinder-56bb6c10-fdca-4b74-b907-c4627a5cf8c5-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:10 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6a963ceb-48fe-4a44-b50b-8bc4f59350b0 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "cinder-9800d174-592f-4efc-bc64-bbb925ae1956-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:10 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6a963ceb-48fe-4a44-b50b-8bc4f59350b0 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "cinder-9800d174-592f-4efc-bc64-bbb925ae1956-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:10 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6a963ceb-48fe-4a44-b50b-8bc4f59350b0 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "cinder-quobyte-9800d174-592f-4efc-bc64-bbb925ae1956" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:10 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6a963ceb-48fe-4a44-b50b-8bc4f59350b0 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "cinder-quobyte-9800d174-592f-4efc-bc64-bbb925ae1956" acquired by "delete_volume" :: waited 0.017s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:10 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7995ae5-7036-470d-86db-87af9d72999d]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6a963ceb-48fe-4a44-b50b-8bc4f59350b0 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9800d174-592f-4efc-bc64-bbb925ae1956 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:10 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9800d174-592f-4efc-bc64-bbb925ae1956 Sep 21 12:11:10 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:10 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6a963ceb-48fe-4a44-b50b-8bc4f59350b0 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9800d174-592f-4efc-bc64-bbb925ae1956" returned: 0 in 0.501s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6a963ceb-48fe-4a44-b50b-8bc4f59350b0 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9800d174-592f-4efc-bc64-bbb925ae1956 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:10 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9800d174-592f-4efc-bc64-bbb925ae1956 Sep 21 12:11:10 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:10 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6a963ceb-48fe-4a44-b50b-8bc4f59350b0 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9800d174-592f-4efc-bc64-bbb925ae1956" returned: 0 in 0.316s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6a963ceb-48fe-4a44-b50b-8bc4f59350b0 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "cinder-quobyte-9800d174-592f-4efc-bc64-bbb925ae1956" released by "delete_volume" :: held 0.878s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-6a963ceb-48fe-4a44-b50b-8bc4f59350b0 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Created reservations ['c50568f6-86ad-465a-b58d-673cbb7269a2', '91a25851-b133-431a-a6ea-3ac2927c4a17', '52a97c3f-8c9c-41ec-b5da-bd68bc2e6f4f', '5944e0e9-bc91-4fd0-8720-9fc543e76ddb'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6a963ceb-48fe-4a44-b50b-8bc4f59350b0 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6a963ceb-48fe-4a44-b50b-8bc4f59350b0 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6a963ceb-48fe-4a44-b50b-8bc4f59350b0 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6a963ceb-48fe-4a44-b50b-8bc4f59350b0 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6a963ceb-48fe-4a44-b50b-8bc4f59350b0 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6a963ceb-48fe-4a44-b50b-8bc4f59350b0 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:11 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:11:11 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-63ed9bea-4f7b-40ed-b0ee-f8d3a7549c5e tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "cinder-cfc5e555-096e-4e29-839b-da1d46bb3d63-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-63ed9bea-4f7b-40ed-b0ee-f8d3a7549c5e tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "cinder-cfc5e555-096e-4e29-839b-da1d46bb3d63-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=171,cinder:UPDATE=264,cinder:INSERT=57,cinder:DELETE=20 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-63ed9bea-4f7b-40ed-b0ee-f8d3a7549c5e tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "cinder-quobyte-cfc5e555-096e-4e29-839b-da1d46bb3d63" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-63ed9bea-4f7b-40ed-b0ee-f8d3a7549c5e tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "cinder-quobyte-cfc5e555-096e-4e29-839b-da1d46bb3d63" acquired by "delete_volume" :: waited 0.019s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5555182-a41b-49ce-8770-724761298908]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-63ed9bea-4f7b-40ed-b0ee-f8d3a7549c5e tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-cfc5e555-096e-4e29-839b-da1d46bb3d63 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:11 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-cfc5e555-096e-4e29-839b-da1d46bb3d63 Sep 21 12:11:11 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:11 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6a963ceb-48fe-4a44-b50b-8bc4f59350b0 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.531s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-6a963ceb-48fe-4a44-b50b-8bc4f59350b0 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:11:11 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-6a963ceb-48fe-4a44-b50b-8bc4f59350b0 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Deleted volume successfully. Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6a963ceb-48fe-4a44-b50b-8bc4f59350b0 tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "cinder-9800d174-592f-4efc-bc64-bbb925ae1956-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=171,cinder:UPDATE=220,cinder:DELETE=23,cinder:INSERT=65 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Flow 'volume_create_manager' (7227fceb-98bd-490b-bb0a-c30202605b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f5af18-1ead-4237-8a0b-3300a81f55b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:11 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-63ed9bea-4f7b-40ed-b0ee-f8d3a7549c5e tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-cfc5e555-096e-4e29-839b-da1d46bb3d63" returned: 0 in 0.458s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-63ed9bea-4f7b-40ed-b0ee-f8d3a7549c5e tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-cfc5e555-096e-4e29-839b-da1d46bb3d63 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f5af18-1ead-4237-8a0b-3300a81f55b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1343130941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73467e2-763e-4241-88d8-fcd8a24bf8b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb8e58032794228b9717874dd335169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:12Z,use_quota=True,user_id='2c049c0e546f420296212675b08da21c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a647619-c8cb-4d06-b17f-13f2fd4facfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a647619-c8cb-4d06-b17f-13f2fd4facfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:11 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-cfc5e555-096e-4e29-839b-da1d46bb3d63 Sep 21 12:11:11 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (029b0f3f-c1ce-4301-8599-34e42395e1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (029b0f3f-c1ce-4301-8599-34e42395e1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd73467e2-763e-4241-88d8-fcd8a24bf8b9', 'volume_name': 'volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aec5d47-4668-452a-98c1-a4631987e0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aec5d47-4668-452a-98c1-a4631987e0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27449ce-d7c8-4a20-9fdd-f75cd5b602bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:11 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Volume d73467e2-763e-4241-88d8-fcd8a24bf8b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9', 'volume_size': 1} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1343130941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d73467e2-763e-4241-88d8-fcd8a24bf8b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb8e58032794228b9717874dd335169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:12Z,use_quota=True,user_id='2c049c0e546f420296212675b08da21c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Creating volume d73467e2-763e-4241-88d8-fcd8a24bf8b9 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:11:11 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:11:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:12 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9 1073741824 Sep 21 12:11:12 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:12 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-63ed9bea-4f7b-40ed-b0ee-f8d3a7549c5e tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-cfc5e555-096e-4e29-839b-da1d46bb3d63" returned: 0 in 0.285s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-63ed9bea-4f7b-40ed-b0ee-f8d3a7549c5e tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "cinder-quobyte-cfc5e555-096e-4e29-839b-da1d46bb3d63" released by "delete_volume" :: held 0.828s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:12 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-63ed9bea-4f7b-40ed-b0ee-f8d3a7549c5e tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Created reservations ['34ca5535-246e-42cf-97be-9880380bf0b9', 'eca05b26-5fc2-4987-9396-56e94d7a044a', 'bdbe3bc1-ff6f-4cca-8bb8-1ce0cbda7916', '9e118efa-2495-403f-a0a4-1c87c9c887ae'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-63ed9bea-4f7b-40ed-b0ee-f8d3a7549c5e tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-63ed9bea-4f7b-40ed-b0ee-f8d3a7549c5e tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:12 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-63ed9bea-4f7b-40ed-b0ee-f8d3a7549c5e tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:12 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-63ed9bea-4f7b-40ed-b0ee-f8d3a7549c5e tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-63ed9bea-4f7b-40ed-b0ee-f8d3a7549c5e tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-63ed9bea-4f7b-40ed-b0ee-f8d3a7549c5e tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:12 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:11:12 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-39c4b895-444e-42f6-afbb-83dcae5cd63f tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "cinder-f5d96886-4860-40d3-828c-34e9a0b772ea-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-39c4b895-444e-42f6-afbb-83dcae5cd63f tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "cinder-f5d96886-4860-40d3-828c-34e9a0b772ea-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:12 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9 1073741824" returned: 0 in 0.621s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-39c4b895-444e-42f6-afbb-83dcae5cd63f tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "cinder-quobyte-f5d96886-4860-40d3-828c-34e9a0b772ea" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-39c4b895-444e-42f6-afbb-83dcae5cd63f tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "cinder-quobyte-f5d96886-4860-40d3-828c-34e9a0b772ea" acquired by "delete_volume" :: waited 0.034s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:12 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9 Sep 21 12:11:12 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:12 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c32bfd8-99fc-44e6-a380-44e5264a1358]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-39c4b895-444e-42f6-afbb-83dcae5cd63f tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f5d96886-4860-40d3-828c-34e9a0b772ea {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:12 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-63ed9bea-4f7b-40ed-b0ee-f8d3a7549c5e tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.401s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:12 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-63ed9bea-4f7b-40ed-b0ee-f8d3a7549c5e tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:11:12 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-63ed9bea-4f7b-40ed-b0ee-f8d3a7549c5e tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Deleted volume successfully. Sep 21 12:11:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-63ed9bea-4f7b-40ed-b0ee-f8d3a7549c5e tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "cinder-cfc5e555-096e-4e29-839b-da1d46bb3d63-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:12 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f5d96886-4860-40d3-828c-34e9a0b772ea Sep 21 12:11:12 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:13 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9" returned: 0 in 0.320s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:13 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:11:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:13 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27449ce-d7c8-4a20-9fdd-f75cd5b602bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:13 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e34e317-b694-430d-ba76-8f728436eefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:13 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Volume volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9 (d73467e2-763e-4241-88d8-fcd8a24bf8b9): created successfully Sep 21 12:11:13 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e34e317-b694-430d-ba76-8f728436eefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:13 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Flow 'volume_create_manager' (7227fceb-98bd-490b-bb0a-c30202605b2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:13 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-b1352212-2a54-4d10-99aa-07b809855048 tempest-ProjectReaderTests-1840639123 None] Created volume successfully. Sep 21 12:11:13 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-39c4b895-444e-42f6-afbb-83dcae5cd63f tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f5d96886-4860-40d3-828c-34e9a0b772ea" returned: 0 in 0.455s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-39c4b895-444e-42f6-afbb-83dcae5cd63f tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f5d96886-4860-40d3-828c-34e9a0b772ea {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:13 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f5d96886-4860-40d3-828c-34e9a0b772ea Sep 21 12:11:13 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:13 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-39c4b895-444e-42f6-afbb-83dcae5cd63f tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f5d96886-4860-40d3-828c-34e9a0b772ea" returned: 0 in 0.275s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:13 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-39c4b895-444e-42f6-afbb-83dcae5cd63f tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "cinder-quobyte-f5d96886-4860-40d3-828c-34e9a0b772ea" released by "delete_volume" :: held 0.807s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:13 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-39c4b895-444e-42f6-afbb-83dcae5cd63f tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Created reservations ['1ccd158a-c010-4dbd-a640-7741d0c1ceb9', '69bed857-32bd-4887-a1c5-b8e461bfe84f', 'c5b6a199-15c2-4b3f-b5b5-6523aa993d96', 'c37f2003-e0cc-47f4-a93a-4ece18b15469'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-39c4b895-444e-42f6-afbb-83dcae5cd63f tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-39c4b895-444e-42f6-afbb-83dcae5cd63f tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:13 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-39c4b895-444e-42f6-afbb-83dcae5cd63f tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:13 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-39c4b895-444e-42f6-afbb-83dcae5cd63f tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-39c4b895-444e-42f6-afbb-83dcae5cd63f tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-39c4b895-444e-42f6-afbb-83dcae5cd63f tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:13 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:11:13 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:14 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-39c4b895-444e-42f6-afbb-83dcae5cd63f tempest-CreateVolumesFromSourceVolumeTest-780841876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.344s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:14 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-39c4b895-444e-42f6-afbb-83dcae5cd63f tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:11:14 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-39c4b895-444e-42f6-afbb-83dcae5cd63f tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Deleted volume successfully. Sep 21 12:11:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-39c4b895-444e-42f6-afbb-83dcae5cd63f tempest-CreateVolumesFromSourceVolumeTest-780841876 None] Lock "cinder-f5d96886-4860-40d3-828c-34e9a0b772ea-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-bd570330-5614-455a-8ba4-bd59b44699d0 tempest-ProjectReaderTests-1840639123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-bd570330-5614-455a-8ba4-bd59b44699d0 tempest-ProjectReaderTests-1840639123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:14 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-bd570330-5614-455a-8ba4-bd59b44699d0 tempest-ProjectReaderTests-1840639123 None] Creating offline snapshot dcfa0d3b-5cf2-4554-919c-db687d13c3e3 of volume d73467e2-763e-4241-88d8-fcd8a24bf8b9 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:11:14 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1a251c-6873-47c3-8b7f-3b591004592e]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bd570330-5614-455a-8ba4-bd59b44699d0 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:14 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9 Sep 21 12:11:14 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:14 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:11:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Flow 'volume_create_manager' (2ff65cd7-970e-4426-b2d7-dc559084b2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e879da8-4e82-4a88-8c1f-9af5ff69bc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:14 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bd570330-5614-455a-8ba4-bd59b44699d0 tempest-ProjectReaderTests-1840639123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9" returned: 0 in 0.484s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bd570330-5614-455a-8ba4-bd59b44699d0 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9.dcfa0d3b-5cf2-4554-919c-db687d13c3e3 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:14 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9.dcfa0d3b-5cf2-4554-919c-db687d13c3e3 1G Sep 21 12:11:14 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e879da8-4e82-4a88-8c1f-9af5ff69bc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-819855685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b92b796-14a5-433f-b6b2-5b91ea53a101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5784ccfa10af483ea2bc48a66b5a5be8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:15Z,use_quota=True,user_id='05add27cf6974b77a3e6f3a208a4ba25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a028504a-3dcf-4a35-9fb0-1bb64eeda60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a028504a-3dcf-4a35-9fb0-1bb64eeda60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62adac9c-71fd-4c89-bdbd-002c16889038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62adac9c-71fd-4c89-bdbd-002c16889038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b92b796-14a5-433f-b6b2-5b91ea53a101', 'volume_name': 'volume-8b92b796-14a5-433f-b6b2-5b91ea53a101', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8540049f-1997-441d-9709-de6ce017945f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8540049f-1997-441d-9709-de6ce017945f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:14 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d6c4bb-5478-4a7c-9c3a-9df3daac7010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:14 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Volume 8b92b796-14a5-433f-b6b2-5b91ea53a101: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b92b796-14a5-433f-b6b2-5b91ea53a101', 'volume_size': 1} Sep 21 12:11:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:15 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bd570330-5614-455a-8ba4-bd59b44699d0 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9.dcfa0d3b-5cf2-4554-919c-db687d13c3e3 1G" returned: 0 in 0.495s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bd570330-5614-455a-8ba4-bd59b44699d0 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9.dcfa0d3b-5cf2-4554-919c-db687d13c3e3 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:15 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9.dcfa0d3b-5cf2-4554-919c-db687d13c3e3 Sep 21 12:11:15 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:15 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bd570330-5614-455a-8ba4-bd59b44699d0 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9.dcfa0d3b-5cf2-4554-919c-db687d13c3e3" returned: 0 in 0.380s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:15 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-bd570330-5614-455a-8ba4-bd59b44699d0 tempest-ProjectReaderTests-1840639123 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9.dcfa0d3b-5cf2-4554-919c-db687d13c3e3 is being set with open permissions: ugo+rw Sep 21 12:11:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bd570330-5614-455a-8ba4-bd59b44699d0 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9.dcfa0d3b-5cf2-4554-919c-db687d13c3e3 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:15 devstack sudo[105394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9.dcfa0d3b-5cf2-4554-919c-db687d13c3e3 Sep 21 12:11:15 devstack sudo[105394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:15 devstack sudo[105394]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bd570330-5614-455a-8ba4-bd59b44699d0 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9.dcfa0d3b-5cf2-4554-919c-db687d13c3e3" returned: 0 in 0.252s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bd570330-5614-455a-8ba4-bd59b44699d0 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:15 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9.info Sep 21 12:11:15 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:16 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bd570330-5614-455a-8ba4-bd59b44699d0 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9.info" returned: 0 in 0.264s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:16 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-bd570330-5614-455a-8ba4-bd59b44699d0 tempest-ProjectReaderTests-1840639123 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9.info is being set with open permissions: ugo+rw Sep 21 12:11:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bd570330-5614-455a-8ba4-bd59b44699d0 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:16 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9.info Sep 21 12:11:16 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:16 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-bd570330-5614-455a-8ba4-bd59b44699d0 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9.info" returned: 0 in 0.265s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-bd570330-5614-455a-8ba4-bd59b44699d0 tempest-ProjectReaderTests-1840639123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.259s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.642s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-819855685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b92b796-14a5-433f-b6b2-5b91ea53a101,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5784ccfa10af483ea2bc48a66b5a5be8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:15Z,use_quota=True,user_id='05add27cf6974b77a3e6f3a208a4ba25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:11:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Creating volume 8b92b796-14a5-433f-b6b2-5b91ea53a101 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:11:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:16 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:11:16 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:11:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8b92b796-14a5-433f-b6b2-5b91ea53a101 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:16 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8b92b796-14a5-433f-b6b2-5b91ea53a101 1073741824 Sep 21 12:11:16 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:16 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-bd570330-5614-455a-8ba4-bd59b44699d0 tempest-ProjectReaderTests-1840639123 None] Create snapshot completed successfully Sep 21 12:11:16 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8b92b796-14a5-433f-b6b2-5b91ea53a101 1073741824" returned: 0 in 0.470s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8b92b796-14a5-433f-b6b2-5b91ea53a101 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:16 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8b92b796-14a5-433f-b6b2-5b91ea53a101 Sep 21 12:11:16 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:17 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8b92b796-14a5-433f-b6b2-5b91ea53a101" returned: 0 in 0.285s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:17 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:11:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d6c4bb-5478-4a7c-9c3a-9df3daac7010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b92b796-14a5-433f-b6b2-5b91ea53a101', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917edc15-dd26-43a7-8141-92466d90fccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:17 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Volume volume-8b92b796-14a5-433f-b6b2-5b91ea53a101 (8b92b796-14a5-433f-b6b2-5b91ea53a101): created successfully Sep 21 12:11:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917edc15-dd26-43a7-8141-92466d90fccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:17 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Flow 'volume_create_manager' (2ff65cd7-970e-4426-b2d7-dc559084b2f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:17 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-a29e73e6-9ac1-4ee5-9059-60f01d8e8277 tempest-ProjectReaderTests-1777203705 None] Created volume successfully. Sep 21 12:11:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-25ebf7bf-c8fa-42f9-a7fb-658650a2c2bd tempest-ProjectReaderTests-1840639123 None] Acquiring lock "cinder-dcfa0d3b-5cf2-4554-919c-db687d13c3e3-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-25ebf7bf-c8fa-42f9-a7fb-658650a2c2bd tempest-ProjectReaderTests-1840639123 None] Lock "cinder-dcfa0d3b-5cf2-4554-919c-db687d13c3e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-25ebf7bf-c8fa-42f9-a7fb-658650a2c2bd tempest-ProjectReaderTests-1840639123 None] Acquiring lock "cinder-quobyte-d73467e2-763e-4241-88d8-fcd8a24bf8b9" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-25ebf7bf-c8fa-42f9-a7fb-658650a2c2bd tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-d73467e2-763e-4241-88d8-fcd8a24bf8b9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-25ebf7bf-c8fa-42f9-a7fb-658650a2c2bd tempest-ProjectReaderTests-1840639123 None] Acquiring lock "cinder-quobyte-dcfa0d3b-5cf2-4554-919c-db687d13c3e3" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-25ebf7bf-c8fa-42f9-a7fb-658650a2c2bd tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-dcfa0d3b-5cf2-4554-919c-db687d13c3e3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:17 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-25ebf7bf-c8fa-42f9-a7fb-658650a2c2bd tempest-ProjectReaderTests-1840639123 None] Deleting offline snapshot dcfa0d3b-5cf2-4554-919c-db687d13c3e3 of volume d73467e2-763e-4241-88d8-fcd8a24bf8b9 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:11:17 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-25ebf7bf-c8fa-42f9-a7fb-658650a2c2bd tempest-ProjectReaderTests-1840639123 None] snapshot_file for this snap is: volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9.dcfa0d3b-5cf2-4554-919c-db687d13c3e3 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:11:17 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2d098e-c16e-4236-bee2-a71e02adc397]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-25ebf7bf-c8fa-42f9-a7fb-658650a2c2bd tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9.dcfa0d3b-5cf2-4554-919c-db687d13c3e3 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:17 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9.dcfa0d3b-5cf2-4554-919c-db687d13c3e3 Sep 21 12:11:17 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e5a0b5bf-bf80-4759-baf4-d3f1bd693f37 tempest-ProjectReaderTests-1777203705 None] Acquiring lock "cinder-8b92b796-14a5-433f-b6b2-5b91ea53a101-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:18 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e5a0b5bf-bf80-4759-baf4-d3f1bd693f37 tempest-ProjectReaderTests-1777203705 None] Lock "cinder-8b92b796-14a5-433f-b6b2-5b91ea53a101-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:18 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e5a0b5bf-bf80-4759-baf4-d3f1bd693f37 tempest-ProjectReaderTests-1777203705 None] Acquiring lock "cinder-quobyte-8b92b796-14a5-433f-b6b2-5b91ea53a101" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:18 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e5a0b5bf-bf80-4759-baf4-d3f1bd693f37 tempest-ProjectReaderTests-1777203705 None] Lock "cinder-quobyte-8b92b796-14a5-433f-b6b2-5b91ea53a101" acquired by "delete_volume" :: waited 0.021s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:18 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[bece2cf4-0301-462f-b934-5668240912bf]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e5a0b5bf-bf80-4759-baf4-d3f1bd693f37 tempest-ProjectReaderTests-1777203705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8b92b796-14a5-433f-b6b2-5b91ea53a101 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:18 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-25ebf7bf-c8fa-42f9-a7fb-658650a2c2bd tempest-ProjectReaderTests-1840639123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9.dcfa0d3b-5cf2-4554-919c-db687d13c3e3" returned: 0 in 0.476s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:18 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-25ebf7bf-c8fa-42f9-a7fb-658650a2c2bd tempest-ProjectReaderTests-1840639123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:11:18 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f9f8a1-a029-4b4c-b70c-0312fc533da6]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-25ebf7bf-c8fa-42f9-a7fb-658650a2c2bd tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:18 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8b92b796-14a5-433f-b6b2-5b91ea53a101 Sep 21 12:11:18 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:18 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9 Sep 21 12:11:18 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:18 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e5a0b5bf-bf80-4759-baf4-d3f1bd693f37 tempest-ProjectReaderTests-1777203705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8b92b796-14a5-433f-b6b2-5b91ea53a101" returned: 0 in 0.445s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e5a0b5bf-bf80-4759-baf4-d3f1bd693f37 tempest-ProjectReaderTests-1777203705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8b92b796-14a5-433f-b6b2-5b91ea53a101 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:18 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-25ebf7bf-c8fa-42f9-a7fb-658650a2c2bd tempest-ProjectReaderTests-1840639123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9" returned: 0 in 0.406s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-25ebf7bf-c8fa-42f9-a7fb-658650a2c2bd tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9.dcfa0d3b-5cf2-4554-919c-db687d13c3e3 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:18 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8b92b796-14a5-433f-b6b2-5b91ea53a101 Sep 21 12:11:18 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:18 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9.dcfa0d3b-5cf2-4554-919c-db687d13c3e3 Sep 21 12:11:18 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:18 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e5a0b5bf-bf80-4759-baf4-d3f1bd693f37 tempest-ProjectReaderTests-1777203705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8b92b796-14a5-433f-b6b2-5b91ea53a101" returned: 0 in 0.283s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:18 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e5a0b5bf-bf80-4759-baf4-d3f1bd693f37 tempest-ProjectReaderTests-1777203705 None] Lock "cinder-quobyte-8b92b796-14a5-433f-b6b2-5b91ea53a101" released by "delete_volume" :: held 0.791s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:18 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-e5a0b5bf-bf80-4759-baf4-d3f1bd693f37 tempest-ProjectReaderTests-1777203705 None] Created reservations ['76f7db7f-c5a2-4a4e-b15a-d7e63de33d3d', 'a9fa8ba0-4093-4833-b47b-65f6ab2cf88f', '5dc87493-95aa-4d6f-b430-6190a5e34a77', '58fc7d01-7e60-42ae-8bcd-7996732c6f63'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:19 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-25ebf7bf-c8fa-42f9-a7fb-658650a2c2bd tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9.dcfa0d3b-5cf2-4554-919c-db687d13c3e3" returned: 0 in 0.418s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-25ebf7bf-c8fa-42f9-a7fb-658650a2c2bd tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9.dcfa0d3b-5cf2-4554-919c-db687d13c3e3 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:19 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9.dcfa0d3b-5cf2-4554-919c-db687d13c3e3 Sep 21 12:11:19 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e5a0b5bf-bf80-4759-baf4-d3f1bd693f37 tempest-ProjectReaderTests-1777203705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e5a0b5bf-bf80-4759-baf4-d3f1bd693f37 tempest-ProjectReaderTests-1777203705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:19 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e5a0b5bf-bf80-4759-baf4-d3f1bd693f37 tempest-ProjectReaderTests-1777203705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:19 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e5a0b5bf-bf80-4759-baf4-d3f1bd693f37 tempest-ProjectReaderTests-1777203705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e5a0b5bf-bf80-4759-baf4-d3f1bd693f37 tempest-ProjectReaderTests-1777203705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e5a0b5bf-bf80-4759-baf4-d3f1bd693f37 tempest-ProjectReaderTests-1777203705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:19 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:11:19 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:19 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-25ebf7bf-c8fa-42f9-a7fb-658650a2c2bd tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9.dcfa0d3b-5cf2-4554-919c-db687d13c3e3" returned: 0 in 0.281s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-25ebf7bf-c8fa-42f9-a7fb-658650a2c2bd tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-dcfa0d3b-5cf2-4554-919c-db687d13c3e3" released by "_delete_snapshot" :: held 1.740s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-25ebf7bf-c8fa-42f9-a7fb-658650a2c2bd tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-d73467e2-763e-4241-88d8-fcd8a24bf8b9" released by "delete_snapshot" :: held 1.768s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:19 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e5a0b5bf-bf80-4759-baf4-d3f1bd693f37 tempest-ProjectReaderTests-1777203705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.318s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:19 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-e5a0b5bf-bf80-4759-baf4-d3f1bd693f37 tempest-ProjectReaderTests-1777203705 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:11:19 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-e5a0b5bf-bf80-4759-baf4-d3f1bd693f37 tempest-ProjectReaderTests-1777203705 None] Deleted volume successfully. Sep 21 12:11:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e5a0b5bf-bf80-4759-baf4-d3f1bd693f37 tempest-ProjectReaderTests-1777203705 None] Lock "cinder-8b92b796-14a5-433f-b6b2-5b91ea53a101-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:19 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-25ebf7bf-c8fa-42f9-a7fb-658650a2c2bd tempest-ProjectReaderTests-1840639123 None] Created reservations ['f8eec213-3cb4-41a0-8294-9e178ffe47d1', '26f71793-e708-4799-9b72-1d7d810c6474', 'c9ba951d-a6e2-49e0-9e85-fee013039b0a', '77275653-e47f-4e80-8eca-b34f904bc05a'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:19 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-25ebf7bf-c8fa-42f9-a7fb-658650a2c2bd tempest-ProjectReaderTests-1840639123 None] Delete snapshot completed successfully. Sep 21 12:11:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-25ebf7bf-c8fa-42f9-a7fb-658650a2c2bd tempest-ProjectReaderTests-1840639123 None] Lock "cinder-dcfa0d3b-5cf2-4554-919c-db687d13c3e3-delete_snapshot" released by "delete_snapshot" :: held 2.048s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-86a4a734-0acd-4548-9897-542077631e16 tempest-ProjectReaderTests-1840639123 None] Acquiring lock "cinder-d73467e2-763e-4241-88d8-fcd8a24bf8b9-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-86a4a734-0acd-4548-9897-542077631e16 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-d73467e2-763e-4241-88d8-fcd8a24bf8b9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-86a4a734-0acd-4548-9897-542077631e16 tempest-ProjectReaderTests-1840639123 None] Acquiring lock "cinder-quobyte-d73467e2-763e-4241-88d8-fcd8a24bf8b9" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:19 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-86a4a734-0acd-4548-9897-542077631e16 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-d73467e2-763e-4241-88d8-fcd8a24bf8b9" acquired by "delete_volume" :: waited 0.025s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:19 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2377c6-0686-4cf5-bf89-450c35f21588]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-86a4a734-0acd-4548-9897-542077631e16 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:19 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:11:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Flow 'volume_create_manager' (9bf9245f-ff03-40ee-b76f-9369b635d732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ca01bc6-4773-4db8-95ef-86c474622d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:20 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9 Sep 21 12:11:20 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ca01bc6-4773-4db8-95ef-86c474622d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-413299325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fef52ef-547d-4d49-a873-6e7ce057152a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5784ccfa10af483ea2bc48a66b5a5be8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:20Z,use_quota=True,user_id='05add27cf6974b77a3e6f3a208a4ba25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02fd7c05-f88d-4bc1-abac-66450e4f8474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02fd7c05-f88d-4bc1-abac-66450e4f8474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb80210-9d17-45c5-8bf6-25a4cd991880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eb80210-9d17-45c5-8bf6-25a4cd991880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fef52ef-547d-4d49-a873-6e7ce057152a', 'volume_name': 'volume-7fef52ef-547d-4d49-a873-6e7ce057152a', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d93654b6-028f-4f48-9bfc-9e9d4498e81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d93654b6-028f-4f48-9bfc-9e9d4498e81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b222bdc-46c7-4bf6-a7dc-79ce55c4c0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:20 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Volume 7fef52ef-547d-4d49-a873-6e7ce057152a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fef52ef-547d-4d49-a873-6e7ce057152a', 'volume_size': 1} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-413299325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fef52ef-547d-4d49-a873-6e7ce057152a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5784ccfa10af483ea2bc48a66b5a5be8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:20Z,use_quota=True,user_id='05add27cf6974b77a3e6f3a208a4ba25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Creating volume 7fef52ef-547d-4d49-a873-6e7ce057152a {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:11:20 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7fef52ef-547d-4d49-a873-6e7ce057152a 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:11:20 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7fef52ef-547d-4d49-a873-6e7ce057152a 1073741824 Sep 21 12:11:20 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Flow 'volume_create_manager' (e43505cd-b57e-41ed-8817-2f39720e0854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55392913-3020-4ed4-be8a-c852c6019348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55392913-3020-4ed4-be8a-c852c6019348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e94d10f-654e-4410-a3ce-d660ae1d5e2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='344c969a30cd4f1eb4b687503685e3ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:20Z,use_quota=True,user_id='c52107fcab7c4485ba2290ae3f5a407c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e93da297-c2d1-47c3-9d63-a66ffefef808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e93da297-c2d1-47c3-9d63-a66ffefef808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a10aca5-c0b0-497c-9610-429394fd8375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.image.glance [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Creating Keystone auth plugin from conf {{(pid=86366) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 21 12:11:20 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-86a4a734-0acd-4548-9897-542077631e16 tempest-ProjectReaderTests-1840639123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9" returned: 0 in 0.411s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-86a4a734-0acd-4548-9897-542077631e16 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:20 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9 Sep 21 12:11:20 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a10aca5-c0b0-497c-9610-429394fd8375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2e94d10f-654e-4410-a3ce-d660ae1d5e2c', 'volume_name': 'volume-2e94d10f-654e-4410-a3ce-d660ae1d5e2c', 'volume_size': 1, 'image_id': 'fe242277-a049-4e7f-bb71-ed656d80d85c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe242277-a049-4e7f-bb71-ed656d80d85c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1eb9640aaddfe3fa7f7d04c7092ddc93', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '344c969a30cd4f1eb4b687503685e3ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5b2dd5f4cee72d50ed6d3d31de8487db95a9648cc6c6b87816b9a9003f34987b27818864240d4cef320e919be412d33c3c802f84bc74542fb44d4240b16d2cf4', 'id': 'fe242277-a049-4e7f-bb71-ed656d80d85c', 'created_at': datetime.datetime(2026, 9, 21, 10, 11, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 10, 11, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe242277-a049-4e7f-bb71-ed656d80d85c/file', 'properties': {}}, 'image_service': }' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf5a3772-6304-47a2-99d3-e12066c802f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf5a3772-6304-47a2-99d3-e12066c802f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ead46f-0db7-438c-a670-8c6e6a74ed66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:20 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Volume 2e94d10f-654e-4410-a3ce-d660ae1d5e2c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2e94d10f-654e-4410-a3ce-d660ae1d5e2c', 'volume_size': 1, 'image_id': 'fe242277-a049-4e7f-bb71-ed656d80d85c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe242277-a049-4e7f-bb71-ed656d80d85c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1eb9640aaddfe3fa7f7d04c7092ddc93', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '344c969a30cd4f1eb4b687503685e3ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5b2dd5f4cee72d50ed6d3d31de8487db95a9648cc6c6b87816b9a9003f34987b27818864240d4cef320e919be412d33c3c802f84bc74542fb44d4240b16d2cf4', 'id': 'fe242277-a049-4e7f-bb71-ed656d80d85c', 'created_at': datetime.datetime(2026, 9, 21, 10, 11, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 10, 11, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe242277-a049-4e7f-bb71-ed656d80d85c/file', 'properties': {}}, 'image_service': } Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Trying to clone 2e94d10f-654e-4410-a3ce-d660ae1d5e2c from image fe242277-a049-4e7f-bb71-ed656d80d85c at location (None, [{'url': 'file:///opt/stack/data/glance/images/fe242277-a049-4e7f-bb71-ed656d80d85c', 'metadata': {}}]). {{(pid=86366) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fe242277-a049-4e7f-bb71-ed656d80d85c_ux_vh_4adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 21 12:11:20 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Image download 0.00 MB at 0.00 MB/s Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[5546f556-6296-429a-a9a0-337b1a292683]: (4, 'raw') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe242277-a049-4e7f-bb71-ed656d80d85c_ux_vh_4adevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:20 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:20 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7fef52ef-547d-4d49-a873-6e7ce057152a 1073741824" returned: 0 in 0.509s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-86a4a734-0acd-4548-9897-542077631e16 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-d73467e2-763e-4241-88d8-fcd8a24bf8b9" returned: 0 in 0.279s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-86a4a734-0acd-4548-9897-542077631e16 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-d73467e2-763e-4241-88d8-fcd8a24bf8b9" released by "delete_volume" :: held 0.760s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7fef52ef-547d-4d49-a873-6e7ce057152a {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:20 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7fef52ef-547d-4d49-a873-6e7ce057152a Sep 21 12:11:20 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:20 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe242277-a049-4e7f-bb71-ed656d80d85c_ux_vh_4adevstack@QuobyteHD Sep 21 12:11:20 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-86a4a734-0acd-4548-9897-542077631e16 tempest-ProjectReaderTests-1840639123 None] Created reservations ['85eda4ab-ec30-4e98-bbc4-8aa91d674d37', '6336e101-558b-486f-9647-6669d510b495', 'a36bcf45-e0bc-47ae-9a27-cdf3fe1b7cb3', 'df9a9308-6808-44e1-8f7b-80a7aead1fc8'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-86a4a734-0acd-4548-9897-542077631e16 tempest-ProjectReaderTests-1840639123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-86a4a734-0acd-4548-9897-542077631e16 tempest-ProjectReaderTests-1840639123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-86a4a734-0acd-4548-9897-542077631e16 tempest-ProjectReaderTests-1840639123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-86a4a734-0acd-4548-9897-542077631e16 tempest-ProjectReaderTests-1840639123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-86a4a734-0acd-4548-9897-542077631e16 tempest-ProjectReaderTests-1840639123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-86a4a734-0acd-4548-9897-542077631e16 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:20 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:11:20 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:20 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7fef52ef-547d-4d49-a873-6e7ce057152a" returned: 0 in 0.314s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:20 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b222bdc-46c7-4bf6-a7dc-79ce55c4c0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fef52ef-547d-4d49-a873-6e7ce057152a', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c07e5421-110a-435f-a673-d5d14f4a1b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe242277-a049-4e7f-bb71-ed656d80d85c_ux_vh_4adevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:20 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe242277-a049-4e7f-bb71-ed656d80d85c_ux_vh_4adevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:21 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Volume volume-7fef52ef-547d-4d49-a873-6e7ce057152a (7fef52ef-547d-4d49-a873-6e7ce057152a): created successfully Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c07e5421-110a-435f-a673-d5d14f4a1b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Flow 'volume_create_manager' (9bf9245f-ff03-40ee-b76f-9369b635d732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:21 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-63b0b0bf-ef26-42b9-ac2e-76bc40dd0726 tempest-ProjectReaderTests-1777203705 None] Created volume successfully. Sep 21 12:11:21 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-86a4a734-0acd-4548-9897-542077631e16 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.288s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-86a4a734-0acd-4548-9897-542077631e16 tempest-ProjectReaderTests-1840639123 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:11:21 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-86a4a734-0acd-4548-9897-542077631e16 tempest-ProjectReaderTests-1840639123 None] Deleted volume successfully. Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-86a4a734-0acd-4548-9897-542077631e16 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-d73467e2-763e-4241-88d8-fcd8a24bf8b9-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:21 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe242277-a049-4e7f-bb71-ed656d80d85c_ux_vh_4adevstack@QuobyteHD Sep 21 12:11:21 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:21 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe242277-a049-4e7f-bb71-ed656d80d85c_ux_vh_4adevstack@QuobyteHD" returned: 1 in 0.388s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe242277-a049-4e7f-bb71-ed656d80d85c_ux_vh_4adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Temporary image fe242277-a049-4e7f-bb71-ed656d80d85c is fetched for user c52107fcab7c4485ba2290ae3f5a407c. {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Flow 'volume_create_manager' (e2bac5fb-b82a-4059-b11c-9ab3342b2fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e44e78-2068-46d8-b4e7-99c1188a0b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8aff02-e5a6-4fd8-8c59-df06b582ae04]: (4, 'raw') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe242277-a049-4e7f-bb71-ed656d80d85c_ux_vh_4adevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4e44e78-2068-46d8-b4e7-99c1188a0b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-387742257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb8e58032794228b9717874dd335169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:21Z,use_quota=True,user_id='2c049c0e546f420296212675b08da21c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be572ee8-36a2-44fb-bfb6-2bd39aed64b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be572ee8-36a2-44fb-bfb6-2bd39aed64b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72958798-2355-44ce-a08a-37ff6871ca7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72958798-2355-44ce-a08a-37ff6871ca7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c', 'volume_name': 'volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8599b6-1e1f-41c0-ae0c-30f6adb54acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8599b6-1e1f-41c0-ae0c-30f6adb54acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bbf6bf0-6613-49f6-a3d1-baf7edc6d71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:21 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Volume 261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c', 'volume_size': 1} Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-387742257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb8e58032794228b9717874dd335169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:21Z,use_quota=True,user_id='2c049c0e546f420296212675b08da21c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Creating volume 261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:11:21 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:21 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c 1073741824 Sep 21 12:11:21 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:21 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe242277-a049-4e7f-bb71-ed656d80d85c_ux_vh_4adevstack@QuobyteHD Sep 21 12:11:21 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:21 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe242277-a049-4e7f-bb71-ed656d80d85c_ux_vh_4adevstack@QuobyteHD" returned: 0 in 0.342s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe242277-a049-4e7f-bb71-ed656d80d85c_ux_vh_4adevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:21 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe242277-a049-4e7f-bb71-ed656d80d85c_ux_vh_4adevstack@QuobyteHD Sep 21 12:11:21 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:21 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f77c2ee0-7812-422c-a613-f35f1720af1b tempest-ProjectReaderTests-1777203705 None] Acquiring lock "cinder-7fef52ef-547d-4d49-a873-6e7ce057152a-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f77c2ee0-7812-422c-a613-f35f1720af1b tempest-ProjectReaderTests-1777203705 None] Lock "cinder-7fef52ef-547d-4d49-a873-6e7ce057152a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f77c2ee0-7812-422c-a613-f35f1720af1b tempest-ProjectReaderTests-1777203705 None] Acquiring lock "cinder-quobyte-7fef52ef-547d-4d49-a873-6e7ce057152a" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f77c2ee0-7812-422c-a613-f35f1720af1b tempest-ProjectReaderTests-1777203705 None] Lock "cinder-quobyte-7fef52ef-547d-4d49-a873-6e7ce057152a" acquired by "delete_volume" :: waited 0.015s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:22 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e782151-f187-492f-b71e-a668281db7ad]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f77c2ee0-7812-422c-a613-f35f1720af1b tempest-ProjectReaderTests-1777203705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7fef52ef-547d-4d49-a873-6e7ce057152a {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c 1073741824" returned: 0 in 0.567s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:22 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c Sep 21 12:11:22 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:22 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7fef52ef-547d-4d49-a873-6e7ce057152a Sep 21 12:11:22 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:22 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe242277-a049-4e7f-bb71-ed656d80d85c_ux_vh_4adevstack@QuobyteHD" returned: 1 in 0.399s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe242277-a049-4e7f-bb71-ed656d80d85c_ux_vh_4adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:22 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c" returned: 0 in 0.264s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.196s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e94d10f-654e-4410-a3ce-d660ae1d5e2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='344c969a30cd4f1eb4b687503685e3ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:20Z,use_quota=True,user_id='c52107fcab7c4485ba2290ae3f5a407c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Creating volume 2e94d10f-654e-4410-a3ce-d660ae1d5e2c {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:11:22 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2e94d10f-654e-4410-a3ce-d660ae1d5e2c 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bbf6bf0-6613-49f6-a3d1-baf7edc6d71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:22 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2e94d10f-654e-4410-a3ce-d660ae1d5e2c 1073741824 Sep 21 12:11:22 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (201628c8-579a-44ac-a5bd-331c911b9552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:22 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Volume volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c (261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c): created successfully Sep 21 12:11:22 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (201628c8-579a-44ac-a5bd-331c911b9552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Flow 'volume_create_manager' (e2bac5fb-b82a-4059-b11c-9ab3342b2fa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f77c2ee0-7812-422c-a613-f35f1720af1b tempest-ProjectReaderTests-1777203705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7fef52ef-547d-4d49-a873-6e7ce057152a" returned: 0 in 0.395s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f77c2ee0-7812-422c-a613-f35f1720af1b tempest-ProjectReaderTests-1777203705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7fef52ef-547d-4d49-a873-6e7ce057152a {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:22 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-3a16c9c9-8f0c-470b-bd31-b7262fb0f0ab tempest-ProjectReaderTests-1840639123 None] Created volume successfully. Sep 21 12:11:22 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7fef52ef-547d-4d49-a873-6e7ce057152a Sep 21 12:11:22 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:22 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f77c2ee0-7812-422c-a613-f35f1720af1b tempest-ProjectReaderTests-1777203705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7fef52ef-547d-4d49-a873-6e7ce057152a" returned: 0 in 0.269s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f77c2ee0-7812-422c-a613-f35f1720af1b tempest-ProjectReaderTests-1777203705 None] Lock "cinder-quobyte-7fef52ef-547d-4d49-a873-6e7ce057152a" released by "delete_volume" :: held 0.712s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-f77c2ee0-7812-422c-a613-f35f1720af1b tempest-ProjectReaderTests-1777203705 None] Created reservations ['91650ca6-fcc6-4892-b492-c0a9e4e21d54', 'd12a82e2-c6e2-4166-9f18-9814ef4f03e6', '1466e8d5-b7c1-4ab3-bbb9-2b9d27b326db', '936909ab-06b7-4aa1-94ea-d88c92108863'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:22 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2e94d10f-654e-4410-a3ce-d660ae1d5e2c 1073741824" returned: 0 in 0.449s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f77c2ee0-7812-422c-a613-f35f1720af1b tempest-ProjectReaderTests-1777203705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f77c2ee0-7812-422c-a613-f35f1720af1b tempest-ProjectReaderTests-1777203705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f77c2ee0-7812-422c-a613-f35f1720af1b tempest-ProjectReaderTests-1777203705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-f77c2ee0-7812-422c-a613-f35f1720af1b tempest-ProjectReaderTests-1777203705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f77c2ee0-7812-422c-a613-f35f1720af1b tempest-ProjectReaderTests-1777203705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f77c2ee0-7812-422c-a613-f35f1720af1b tempest-ProjectReaderTests-1777203705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2e94d10f-654e-4410-a3ce-d660ae1d5e2c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:22 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:11:22 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:22 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2e94d10f-654e-4410-a3ce-d660ae1d5e2c Sep 21 12:11:22 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:23 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2e94d10f-654e-4410-a3ce-d660ae1d5e2c" returned: 0 in 0.269s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:23 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:23 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:11:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f77c2ee0-7812-422c-a613-f35f1720af1b tempest-ProjectReaderTests-1777203705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.293s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:23 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-f77c2ee0-7812-422c-a613-f35f1720af1b tempest-ProjectReaderTests-1777203705 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:11:23 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-f77c2ee0-7812-422c-a613-f35f1720af1b tempest-ProjectReaderTests-1777203705 None] Deleted volume successfully. Sep 21 12:11:23 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Attempting download of fe242277-a049-4e7f-bb71-ed656d80d85c ((None, [{'url': 'file:///opt/stack/data/glance/images/fe242277-a049-4e7f-bb71-ed656d80d85c', 'metadata': {}}])) to volume 2e94d10f-654e-4410-a3ce-d660ae1d5e2c. {{(pid=86366) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 21 12:11:23 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-f77c2ee0-7812-422c-a613-f35f1720af1b tempest-ProjectReaderTests-1777203705 None] Lock "cinder-7fef52ef-547d-4d49-a873-6e7ce057152a-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:23 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45d14b4-a071-47fa-9057-961ac2c221e9]: (4, 'raw') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe242277-a049-4e7f-bb71-ed656d80d85c_1l8a4mfx {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:23 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe242277-a049-4e7f-bb71-ed656d80d85c_1l8a4mfx Sep 21 12:11:23 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:23 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fe242277-a049-4e7f-bb71-ed656d80d85c_1l8a4mfx" returned: 0 in 0.374s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe242277-a049-4e7f-bb71-ed656d80d85c_1l8a4mfx {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2536e800-7224-4bd9-98f3-a507f67648df tempest-ProjectReaderTests-1840639123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2536e800-7224-4bd9-98f3-a507f67648df tempest-ProjectReaderTests-1840639123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:23 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-2536e800-7224-4bd9-98f3-a507f67648df tempest-ProjectReaderTests-1840639123 None] Creating offline snapshot 0b1c7095-99f3-430b-8f08-8bff93c8eb30 of volume 261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:11:23 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe242277-a049-4e7f-bb71-ed656d80d85c_1l8a4mfx Sep 21 12:11:23 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:23 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:11:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Flow 'volume_create_manager' (671f586c-5818-4d9f-8645-ab18735ae6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d7f58c6-9eed-4486-b211-2b521b7c8940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:23 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd49b91-840c-4314-9d5a-77aabd0c8a4a]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2536e800-7224-4bd9-98f3-a507f67648df tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d7f58c6-9eed-4486-b211-2b521b7c8940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1006624278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=299bb105-5d4c-47db-99a4-d3c293d3e6b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5784ccfa10af483ea2bc48a66b5a5be8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:24Z,use_quota=True,user_id='05add27cf6974b77a3e6f3a208a4ba25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247d5be2-3611-46a4-85b6-dba542c8ce18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247d5be2-3611-46a4-85b6-dba542c8ce18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b595e100-ad3e-46de-a814-f9055f798e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b595e100-ad3e-46de-a814-f9055f798e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '299bb105-5d4c-47db-99a4-d3c293d3e6b2', 'volume_name': 'volume-299bb105-5d4c-47db-99a4-d3c293d3e6b2', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e64473-3688-4ed9-8f88-24b1fc128c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e64473-3688-4ed9-8f88-24b1fc128c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:23 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c1f627-308c-4c22-9a38-08dabb4016db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:23 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Volume 299bb105-5d4c-47db-99a4-d3c293d3e6b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-299bb105-5d4c-47db-99a4-d3c293d3e6b2', 'volume_size': 1} Sep 21 12:11:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:23 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c Sep 21 12:11:23 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:24 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe242277-a049-4e7f-bb71-ed656d80d85c_1l8a4mfx" returned: 1 in 0.366s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fe242277-a049-4e7f-bb71-ed656d80d85c_1l8a4mfx' failed. Not Retrying. {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 12:11:24 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9a5446-b6e2-45e8-8c51-cc010bd75934]: (4, 'raw') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe242277-a049-4e7f-bb71-ed656d80d85c_ux_vh_4adevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:24 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe242277-a049-4e7f-bb71-ed656d80d85c_ux_vh_4adevstack@QuobyteHD Sep 21 12:11:24 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:24 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2536e800-7224-4bd9-98f3-a507f67648df tempest-ProjectReaderTests-1840639123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c" returned: 0 in 0.411s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2536e800-7224-4bd9-98f3-a507f67648df tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c.0b1c7095-99f3-430b-8f08-8bff93c8eb30 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:24 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c.0b1c7095-99f3-430b-8f08-8bff93c8eb30 1G Sep 21 12:11:24 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:24 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fe242277-a049-4e7f-bb71-ed656d80d85c_ux_vh_4adevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe242277-a049-4e7f-bb71-ed656d80d85c_ux_vh_4adevstack@QuobyteHD {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:24 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe242277-a049-4e7f-bb71-ed656d80d85c_ux_vh_4adevstack@QuobyteHD Sep 21 12:11:24 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:24 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2536e800-7224-4bd9-98f3-a507f67648df tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c.0b1c7095-99f3-430b-8f08-8bff93c8eb30 1G" returned: 0 in 0.460s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2536e800-7224-4bd9-98f3-a507f67648df tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c.0b1c7095-99f3-430b-8f08-8bff93c8eb30 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:24 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c.0b1c7095-99f3-430b-8f08-8bff93c8eb30 Sep 21 12:11:24 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:24 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe242277-a049-4e7f-bb71-ed656d80d85c_ux_vh_4adevstack@QuobyteHD" returned: 1 in 0.383s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fe242277-a049-4e7f-bb71-ed656d80d85c_ux_vh_4adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 21 12:11:24 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] fe242277-a049-4e7f-bb71-ed656d80d85c was raw, converting to qcow2 {{(pid=86366) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 21 12:11:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fe242277-a049-4e7f-bb71-ed656d80d85c_ux_vh_4adevstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2e94d10f-654e-4410-a3ce-d660ae1d5e2c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:24 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fe242277-a049-4e7f-bb71-ed656d80d85c_ux_vh_4adevstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2e94d10f-654e-4410-a3ce-d660ae1d5e2c Sep 21 12:11:24 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:25 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2536e800-7224-4bd9-98f3-a507f67648df tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c.0b1c7095-99f3-430b-8f08-8bff93c8eb30" returned: 0 in 0.307s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:25 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-2536e800-7224-4bd9-98f3-a507f67648df tempest-ProjectReaderTests-1840639123 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c.0b1c7095-99f3-430b-8f08-8bff93c8eb30 is being set with open permissions: ugo+rw Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2536e800-7224-4bd9-98f3-a507f67648df tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c.0b1c7095-99f3-430b-8f08-8bff93c8eb30 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:25 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c.0b1c7095-99f3-430b-8f08-8bff93c8eb30 Sep 21 12:11:25 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:25 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fe242277-a049-4e7f-bb71-ed656d80d85c_ux_vh_4adevstack@QuobyteHD /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2e94d10f-654e-4410-a3ce-d660ae1d5e2c" returned: 0 in 0.499s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fe242277-a049-4e7f-bb71-ed656d80d85c_ux_vh_4adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2e94d10f-654e-4410-a3ce-d660ae1d5e2c {{(pid=86366) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 12:11:25 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Converted 0.00 MB image at 0.00 MB/s Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2e94d10f-654e-4410-a3ce-d660ae1d5e2c 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:25 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2536e800-7224-4bd9-98f3-a507f67648df tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c.0b1c7095-99f3-430b-8f08-8bff93c8eb30" returned: 0 in 0.275s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:25 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2e94d10f-654e-4410-a3ce-d660ae1d5e2c 1G Sep 21 12:11:25 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2536e800-7224-4bd9-98f3-a507f67648df tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:25 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c.info Sep 21 12:11:25 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:25 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2e94d10f-654e-4410-a3ce-d660ae1d5e2c 1G" returned: 0 in 0.313s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Downloaded image fe242277-a049-4e7f-bb71-ed656d80d85c ((None, [{'url': 'file:///opt/stack/data/glance/images/fe242277-a049-4e7f-bb71-ed656d80d85c', 'metadata': {}}])) to volume 2e94d10f-654e-4410-a3ce-d660ae1d5e2c successfully. {{(pid=86366) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 21 12:11:25 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Temporary image fe242277-a049-4e7f-bb71-ed656d80d85c for user c52107fcab7c4485ba2290ae3f5a407c is deleted. {{(pid=86366) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG cinder.volume.volume_utils [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Marking volume 2e94d10f-654e-4410-a3ce-d660ae1d5e2c as bootable. {{(pid=86366) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2536e800-7224-4bd9-98f3-a507f67648df tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c.info" returned: 0 in 0.273s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:25 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-2536e800-7224-4bd9-98f3-a507f67648df tempest-ProjectReaderTests-1840639123 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c.info is being set with open permissions: ugo+rw Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2536e800-7224-4bd9-98f3-a507f67648df tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Copying metadata from image fe242277-a049-4e7f-bb71-ed656d80d85c to 2e94d10f-654e-4410-a3ce-d660ae1d5e2c. {{(pid=86366) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Creating volume glance metadata for volume 2e94d10f-654e-4410-a3ce-d660ae1d5e2c backed by image fe242277-a049-4e7f-bb71-ed656d80d85c with: {'image_id': 'fe242277-a049-4e7f-bb71-ed656d80d85c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1eb9640aaddfe3fa7f7d04c7092ddc93', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86366) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 21 12:11:25 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c.info Sep 21 12:11:25 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ead46f-0db7-438c-a670-8c6e6a74ed66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e94d10f-654e-4410-a3ce-d660ae1d5e2c', 'volume_size': 1, 'image_id': 'fe242277-a049-4e7f-bb71-ed656d80d85c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fe242277-a049-4e7f-bb71-ed656d80d85c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1eb9640aaddfe3fa7f7d04c7092ddc93', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '344c969a30cd4f1eb4b687503685e3ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5b2dd5f4cee72d50ed6d3d31de8487db95a9648cc6c6b87816b9a9003f34987b27818864240d4cef320e919be412d33c3c802f84bc74542fb44d4240b16d2cf4', 'id': 'fe242277-a049-4e7f-bb71-ed656d80d85c', 'created_at': datetime.datetime(2026, 9, 21, 10, 11, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 21, 10, 11, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fe242277-a049-4e7f-bb71-ed656d80d85c/file', 'properties': {}}, 'image_service': }' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e508eab-4d78-4b2e-9200-795c35746900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:25 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Volume volume-2e94d10f-654e-4410-a3ce-d660ae1d5e2c (2e94d10f-654e-4410-a3ce-d660ae1d5e2c): created successfully Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e508eab-4d78-4b2e-9200-795c35746900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Flow 'volume_create_manager' (e43505cd-b57e-41ed-8817-2f39720e0854) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:25 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1f833203-2a49-4e2a-b4f3-e68b95198619 tempest-VolumeImageDependencyTests-1152501910 None] Created volume successfully. Sep 21 12:11:25 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2536e800-7224-4bd9-98f3-a507f67648df tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c.info" returned: 0 in 0.301s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2536e800-7224-4bd9-98f3-a507f67648df tempest-ProjectReaderTests-1840639123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.165s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.024s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1006624278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=299bb105-5d4c-47db-99a4-d3c293d3e6b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5784ccfa10af483ea2bc48a66b5a5be8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:24Z,use_quota=True,user_id='05add27cf6974b77a3e6f3a208a4ba25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Creating volume 299bb105-5d4c-47db-99a4-d3c293d3e6b2 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:11:25 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:11:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-299bb105-5d4c-47db-99a4-d3c293d3e6b2 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:25 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-299bb105-5d4c-47db-99a4-d3c293d3e6b2 1073741824 Sep 21 12:11:25 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:26 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-2536e800-7224-4bd9-98f3-a507f67648df tempest-ProjectReaderTests-1840639123 None] Create snapshot completed successfully Sep 21 12:11:26 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b511a36a-270d-4d2f-a824-e2d166259338 tempest-VolumeImageDependencyTests-1152501910 None] Acquiring lock "cinder-2e94d10f-654e-4410-a3ce-d660ae1d5e2c-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:26 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b511a36a-270d-4d2f-a824-e2d166259338 tempest-VolumeImageDependencyTests-1152501910 None] Lock "cinder-2e94d10f-654e-4410-a3ce-d660ae1d5e2c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:26 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b511a36a-270d-4d2f-a824-e2d166259338 tempest-VolumeImageDependencyTests-1152501910 None] Acquiring lock "cinder-quobyte-2e94d10f-654e-4410-a3ce-d660ae1d5e2c" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:26 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b511a36a-270d-4d2f-a824-e2d166259338 tempest-VolumeImageDependencyTests-1152501910 None] Lock "cinder-quobyte-2e94d10f-654e-4410-a3ce-d660ae1d5e2c" acquired by "delete_volume" :: waited 0.021s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:26 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25bd269-bbaf-4698-a41f-1588b4c83f6d]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b511a36a-270d-4d2f-a824-e2d166259338 tempest-VolumeImageDependencyTests-1152501910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2e94d10f-654e-4410-a3ce-d660ae1d5e2c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:26 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-299bb105-5d4c-47db-99a4-d3c293d3e6b2 1073741824" returned: 0 in 0.505s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-299bb105-5d4c-47db-99a4-d3c293d3e6b2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:26 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-299bb105-5d4c-47db-99a4-d3c293d3e6b2 Sep 21 12:11:26 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:26 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2e94d10f-654e-4410-a3ce-d660ae1d5e2c Sep 21 12:11:26 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:26 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-299bb105-5d4c-47db-99a4-d3c293d3e6b2" returned: 0 in 0.332s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:26 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:11:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:26 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c1f627-308c-4c22-9a38-08dabb4016db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-299bb105-5d4c-47db-99a4-d3c293d3e6b2', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a4a8a4-4ac9-4689-bb00-8efbeb60076f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b511a36a-270d-4d2f-a824-e2d166259338 tempest-VolumeImageDependencyTests-1152501910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2e94d10f-654e-4410-a3ce-d660ae1d5e2c" returned: 0 in 0.449s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b511a36a-270d-4d2f-a824-e2d166259338 tempest-VolumeImageDependencyTests-1152501910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2e94d10f-654e-4410-a3ce-d660ae1d5e2c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:26 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e891677a-6a9a-4f8c-a442-c21dfb0bfad0 tempest-ProjectReaderTests-1840639123 None] Acquiring lock "cinder-0b1c7095-99f3-430b-8f08-8bff93c8eb30-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:26 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2e94d10f-654e-4410-a3ce-d660ae1d5e2c Sep 21 12:11:26 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:26 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Volume volume-299bb105-5d4c-47db-99a4-d3c293d3e6b2 (299bb105-5d4c-47db-99a4-d3c293d3e6b2): created successfully Sep 21 12:11:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a4a8a4-4ac9-4689-bb00-8efbeb60076f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:26 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Flow 'volume_create_manager' (671f586c-5818-4d9f-8645-ab18735ae6ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:26 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e891677a-6a9a-4f8c-a442-c21dfb0bfad0 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-0b1c7095-99f3-430b-8f08-8bff93c8eb30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:26 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e891677a-6a9a-4f8c-a442-c21dfb0bfad0 tempest-ProjectReaderTests-1840639123 None] Acquiring lock "cinder-quobyte-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:26 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-d1180d4d-8876-453d-90f3-482056c88bac tempest-ProjectReaderTests-1777203705 None] Created volume successfully. Sep 21 12:11:26 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e891677a-6a9a-4f8c-a442-c21dfb0bfad0 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:26 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e891677a-6a9a-4f8c-a442-c21dfb0bfad0 tempest-ProjectReaderTests-1840639123 None] Acquiring lock "cinder-quobyte-0b1c7095-99f3-430b-8f08-8bff93c8eb30" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:27 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e891677a-6a9a-4f8c-a442-c21dfb0bfad0 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-0b1c7095-99f3-430b-8f08-8bff93c8eb30" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-e891677a-6a9a-4f8c-a442-c21dfb0bfad0 tempest-ProjectReaderTests-1840639123 None] Deleting offline snapshot 0b1c7095-99f3-430b-8f08-8bff93c8eb30 of volume 261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:11:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-e891677a-6a9a-4f8c-a442-c21dfb0bfad0 tempest-ProjectReaderTests-1840639123 None] snapshot_file for this snap is: volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c.0b1c7095-99f3-430b-8f08-8bff93c8eb30 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:11:27 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65e004d-5774-438e-8d78-85a6de391fcd]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e891677a-6a9a-4f8c-a442-c21dfb0bfad0 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c.0b1c7095-99f3-430b-8f08-8bff93c8eb30 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:27 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c.0b1c7095-99f3-430b-8f08-8bff93c8eb30 Sep 21 12:11:27 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:27 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b511a36a-270d-4d2f-a824-e2d166259338 tempest-VolumeImageDependencyTests-1152501910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-2e94d10f-654e-4410-a3ce-d660ae1d5e2c" returned: 0 in 0.277s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:27 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b511a36a-270d-4d2f-a824-e2d166259338 tempest-VolumeImageDependencyTests-1152501910 None] Lock "cinder-quobyte-2e94d10f-654e-4410-a3ce-d660ae1d5e2c" released by "delete_volume" :: held 0.781s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:27 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-b511a36a-270d-4d2f-a824-e2d166259338 tempest-VolumeImageDependencyTests-1152501910 None] Created reservations ['6c8a4412-0fb6-4064-be00-c0c49680d7f8', '5f69ed7b-bfa0-41c4-945e-187f15168ac2', 'fbb2d8f6-4a24-4cd8-b7a0-98a24036741a', 'dd7fedd5-932b-45ed-9697-7edeee3ab62c'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b511a36a-270d-4d2f-a824-e2d166259338 tempest-VolumeImageDependencyTests-1152501910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b511a36a-270d-4d2f-a824-e2d166259338 tempest-VolumeImageDependencyTests-1152501910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b511a36a-270d-4d2f-a824-e2d166259338 tempest-VolumeImageDependencyTests-1152501910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b511a36a-270d-4d2f-a824-e2d166259338 tempest-VolumeImageDependencyTests-1152501910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b511a36a-270d-4d2f-a824-e2d166259338 tempest-VolumeImageDependencyTests-1152501910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b511a36a-270d-4d2f-a824-e2d166259338 tempest-VolumeImageDependencyTests-1152501910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:27 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:11:27 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:27 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e891677a-6a9a-4f8c-a442-c21dfb0bfad0 tempest-ProjectReaderTests-1840639123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c.0b1c7095-99f3-430b-8f08-8bff93c8eb30" returned: 0 in 0.387s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-e891677a-6a9a-4f8c-a442-c21dfb0bfad0 tempest-ProjectReaderTests-1840639123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:11:27 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[a064629b-159f-411d-b8f9-e9a45e372a27]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e891677a-6a9a-4f8c-a442-c21dfb0bfad0 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:27 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b511a36a-270d-4d2f-a824-e2d166259338 tempest-VolumeImageDependencyTests-1152501910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.282s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:27 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-b511a36a-270d-4d2f-a824-e2d166259338 tempest-VolumeImageDependencyTests-1152501910 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:11:27 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c Sep 21 12:11:27 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:27 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-b511a36a-270d-4d2f-a824-e2d166259338 tempest-VolumeImageDependencyTests-1152501910 None] Deleted volume successfully. Sep 21 12:11:27 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-b511a36a-270d-4d2f-a824-e2d166259338 tempest-VolumeImageDependencyTests-1152501910 None] Lock "cinder-2e94d10f-654e-4410-a3ce-d660ae1d5e2c-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:27 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e891677a-6a9a-4f8c-a442-c21dfb0bfad0 tempest-ProjectReaderTests-1840639123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c" returned: 0 in 0.476s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e891677a-6a9a-4f8c-a442-c21dfb0bfad0 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c.0b1c7095-99f3-430b-8f08-8bff93c8eb30 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:27 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c.0b1c7095-99f3-430b-8f08-8bff93c8eb30 Sep 21 12:11:27 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:28 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fe890ff5-19e3-478a-b91a-8d98e1540f70 tempest-ProjectReaderTests-1777203705 None] Acquiring lock "cinder-299bb105-5d4c-47db-99a4-d3c293d3e6b2-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:28 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fe890ff5-19e3-478a-b91a-8d98e1540f70 tempest-ProjectReaderTests-1777203705 None] Lock "cinder-299bb105-5d4c-47db-99a4-d3c293d3e6b2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:28 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fe890ff5-19e3-478a-b91a-8d98e1540f70 tempest-ProjectReaderTests-1777203705 None] Acquiring lock "cinder-quobyte-299bb105-5d4c-47db-99a4-d3c293d3e6b2" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:28 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fe890ff5-19e3-478a-b91a-8d98e1540f70 tempest-ProjectReaderTests-1777203705 None] Lock "cinder-quobyte-299bb105-5d4c-47db-99a4-d3c293d3e6b2" acquired by "delete_volume" :: waited 0.016s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:28 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[3414e3b4-3163-4148-9857-e6d34da77b4a]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fe890ff5-19e3-478a-b91a-8d98e1540f70 tempest-ProjectReaderTests-1777203705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-299bb105-5d4c-47db-99a4-d3c293d3e6b2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:28 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-299bb105-5d4c-47db-99a4-d3c293d3e6b2 Sep 21 12:11:28 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:28 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e891677a-6a9a-4f8c-a442-c21dfb0bfad0 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c.0b1c7095-99f3-430b-8f08-8bff93c8eb30" returned: 0 in 0.439s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e891677a-6a9a-4f8c-a442-c21dfb0bfad0 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c.0b1c7095-99f3-430b-8f08-8bff93c8eb30 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:28 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c.0b1c7095-99f3-430b-8f08-8bff93c8eb30 Sep 21 12:11:28 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:28 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fe890ff5-19e3-478a-b91a-8d98e1540f70 tempest-ProjectReaderTests-1777203705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-299bb105-5d4c-47db-99a4-d3c293d3e6b2" returned: 0 in 0.427s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fe890ff5-19e3-478a-b91a-8d98e1540f70 tempest-ProjectReaderTests-1777203705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-299bb105-5d4c-47db-99a4-d3c293d3e6b2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:28 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-299bb105-5d4c-47db-99a4-d3c293d3e6b2 Sep 21 12:11:28 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:28 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e891677a-6a9a-4f8c-a442-c21dfb0bfad0 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c.0b1c7095-99f3-430b-8f08-8bff93c8eb30" returned: 0 in 0.293s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:28 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e891677a-6a9a-4f8c-a442-c21dfb0bfad0 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-0b1c7095-99f3-430b-8f08-8bff93c8eb30" released by "_delete_snapshot" :: held 1.736s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:28 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e891677a-6a9a-4f8c-a442-c21dfb0bfad0 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c" released by "delete_snapshot" :: held 1.767s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:28 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-e891677a-6a9a-4f8c-a442-c21dfb0bfad0 tempest-ProjectReaderTests-1840639123 None] Created reservations ['1e5853ed-502c-419d-9499-7a85d2ca9730', '5d208d75-db48-462e-a604-54be8201b8a1', 'dfe117d2-4008-4787-87d7-300b890c1264', 'b3c9deb3-c560-4759-8f05-054069b5c33e'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:28 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-e891677a-6a9a-4f8c-a442-c21dfb0bfad0 tempest-ProjectReaderTests-1840639123 None] Delete snapshot completed successfully. Sep 21 12:11:28 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fe890ff5-19e3-478a-b91a-8d98e1540f70 tempest-ProjectReaderTests-1777203705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-299bb105-5d4c-47db-99a4-d3c293d3e6b2" returned: 0 in 0.322s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:28 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e891677a-6a9a-4f8c-a442-c21dfb0bfad0 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-0b1c7095-99f3-430b-8f08-8bff93c8eb30-delete_snapshot" released by "delete_snapshot" :: held 1.979s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:28 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fe890ff5-19e3-478a-b91a-8d98e1540f70 tempest-ProjectReaderTests-1777203705 None] Lock "cinder-quobyte-299bb105-5d4c-47db-99a4-d3c293d3e6b2" released by "delete_volume" :: held 0.806s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:28 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-fe890ff5-19e3-478a-b91a-8d98e1540f70 tempest-ProjectReaderTests-1777203705 None] Created reservations ['3ab88224-21c8-4edd-ab14-6b12119d14c3', '58fffee2-31e8-403d-a87d-2caad2366ff7', '4b13d0ed-7585-44ec-960b-3a4abcd4ff46', '7936c884-53da-4fd3-bd1d-466a41192535'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fe890ff5-19e3-478a-b91a-8d98e1540f70 tempest-ProjectReaderTests-1777203705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fe890ff5-19e3-478a-b91a-8d98e1540f70 tempest-ProjectReaderTests-1777203705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fe890ff5-19e3-478a-b91a-8d98e1540f70 tempest-ProjectReaderTests-1777203705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fe890ff5-19e3-478a-b91a-8d98e1540f70 tempest-ProjectReaderTests-1777203705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fe890ff5-19e3-478a-b91a-8d98e1540f70 tempest-ProjectReaderTests-1777203705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fe890ff5-19e3-478a-b91a-8d98e1540f70 tempest-ProjectReaderTests-1777203705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2599f3cf-0d59-45f8-9a94-3da476126ddf tempest-ProjectReaderTests-1840639123 None] Acquiring lock "cinder-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:29 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2599f3cf-0d59-45f8-9a94-3da476126ddf tempest-ProjectReaderTests-1840639123 None] Lock "cinder-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:29 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2599f3cf-0d59-45f8-9a94-3da476126ddf tempest-ProjectReaderTests-1840639123 None] Acquiring lock "cinder-quobyte-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2599f3cf-0d59-45f8-9a94-3da476126ddf tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c" acquired by "delete_volume" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8f365d-afa5-4730-80f2-59ddd3071d14]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2599f3cf-0d59-45f8-9a94-3da476126ddf tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:29 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c Sep 21 12:11:29 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:29 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fe890ff5-19e3-478a-b91a-8d98e1540f70 tempest-ProjectReaderTests-1777203705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.419s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-fe890ff5-19e3-478a-b91a-8d98e1540f70 tempest-ProjectReaderTests-1777203705 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:11:29 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-fe890ff5-19e3-478a-b91a-8d98e1540f70 tempest-ProjectReaderTests-1777203705 None] Deleted volume successfully. Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fe890ff5-19e3-478a-b91a-8d98e1540f70 tempest-ProjectReaderTests-1777203705 None] Lock "cinder-299bb105-5d4c-47db-99a4-d3c293d3e6b2-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:29 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Flow 'volume_create_manager' (3a76e943-3bb9-4817-9f90-5d993a5ae17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8194b803-4c8a-4f0c-9b6d-70326fb82818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2599f3cf-0d59-45f8-9a94-3da476126ddf tempest-ProjectReaderTests-1840639123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c" returned: 0 in 0.549s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2599f3cf-0d59-45f8-9a94-3da476126ddf tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8194b803-4c8a-4f0c-9b6d-70326fb82818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1903798172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ad72d1-b626-4379-8341-e963454a367c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5784ccfa10af483ea2bc48a66b5a5be8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:30Z,use_quota=True,user_id='05add27cf6974b77a3e6f3a208a4ba25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3277c715-96b3-4f75-ba3a-1ca5c8fcba8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3277c715-96b3-4f75-ba3a-1ca5c8fcba8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:29 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c Sep 21 12:11:29 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d8c529-3829-4576-b98a-abee6656ac52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d8c529-3829-4576-b98a-abee6656ac52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2ad72d1-b626-4379-8341-e963454a367c', 'volume_name': 'volume-f2ad72d1-b626-4379-8341-e963454a367c', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac2d0d8-1dfd-4ef3-8aeb-a4869f4239cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac2d0d8-1dfd-4ef3-8aeb-a4869f4239cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91436c16-1a5e-4f6f-94cc-64efe945032a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:29 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Volume f2ad72d1-b626-4379-8341-e963454a367c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2ad72d1-b626-4379-8341-e963454a367c', 'volume_size': 1} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1903798172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ad72d1-b626-4379-8341-e963454a367c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5784ccfa10af483ea2bc48a66b5a5be8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:30Z,use_quota=True,user_id='05add27cf6974b77a3e6f3a208a4ba25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Creating volume f2ad72d1-b626-4379-8341-e963454a367c {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:11:29 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:11:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f2ad72d1-b626-4379-8341-e963454a367c 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:29 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f2ad72d1-b626-4379-8341-e963454a367c 1073741824 Sep 21 12:11:29 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:30 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2599f3cf-0d59-45f8-9a94-3da476126ddf tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c" returned: 0 in 0.303s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:30 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2599f3cf-0d59-45f8-9a94-3da476126ddf tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c" released by "delete_volume" :: held 0.950s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:30 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-2599f3cf-0d59-45f8-9a94-3da476126ddf tempest-ProjectReaderTests-1840639123 None] Created reservations ['b04eaf5e-3b29-4618-b0b6-28987443e53e', '13e90092-ebd5-4202-97ef-0f0dd217232b', '944e86a0-983f-4aa9-946f-1a698869a748', '089d32f8-aa90-4a1d-9607-f1074fa0c40e'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2599f3cf-0d59-45f8-9a94-3da476126ddf tempest-ProjectReaderTests-1840639123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2599f3cf-0d59-45f8-9a94-3da476126ddf tempest-ProjectReaderTests-1840639123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:30 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2599f3cf-0d59-45f8-9a94-3da476126ddf tempest-ProjectReaderTests-1840639123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:30 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-2599f3cf-0d59-45f8-9a94-3da476126ddf tempest-ProjectReaderTests-1840639123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2599f3cf-0d59-45f8-9a94-3da476126ddf tempest-ProjectReaderTests-1840639123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2599f3cf-0d59-45f8-9a94-3da476126ddf tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:30 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:11:30 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:30 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f2ad72d1-b626-4379-8341-e963454a367c 1073741824" returned: 0 in 0.558s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f2ad72d1-b626-4379-8341-e963454a367c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:30 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f2ad72d1-b626-4379-8341-e963454a367c Sep 21 12:11:30 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:30 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2599f3cf-0d59-45f8-9a94-3da476126ddf tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.284s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:30 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-2599f3cf-0d59-45f8-9a94-3da476126ddf tempest-ProjectReaderTests-1840639123 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:11:30 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-2599f3cf-0d59-45f8-9a94-3da476126ddf tempest-ProjectReaderTests-1840639123 None] Deleted volume successfully. Sep 21 12:11:30 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2599f3cf-0d59-45f8-9a94-3da476126ddf tempest-ProjectReaderTests-1840639123 None] Lock "cinder-261f2a5c-b85e-4f8b-bffa-4050e5b7fa2c-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:30 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f2ad72d1-b626-4379-8341-e963454a367c" returned: 0 in 0.266s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:30 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:11:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91436c16-1a5e-4f6f-94cc-64efe945032a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2ad72d1-b626-4379-8341-e963454a367c', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e66938e3-3494-41ae-a7cf-abacf306ce49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:30 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Volume volume-f2ad72d1-b626-4379-8341-e963454a367c (f2ad72d1-b626-4379-8341-e963454a367c): created successfully Sep 21 12:11:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e66938e3-3494-41ae-a7cf-abacf306ce49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:30 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Flow 'volume_create_manager' (3a76e943-3bb9-4817-9f90-5d993a5ae17f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:30 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-e30f8e40-2b07-432d-bcb9-1966e65de2b0 tempest-ProjectReaderTests-1777203705 None] Created volume successfully. Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Flow 'volume_create_manager' (59d0c1a1-a717-4fb2-b8f9-4b6d322b932d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cdfef1b-5a5d-41e5-b917-a6ee62189acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cdfef1b-5a5d-41e5-b917-a6ee62189acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=265100fc-1bd7-4ea0-980e-59a729db6031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df7bf91848744a9e9a4351831f026021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:31Z,use_quota=True,user_id='074efa29e48b4636bc065b1baf2b2c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16010f94-ee11-44b8-a567-41db0582dd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16010f94-ee11-44b8-a567-41db0582dd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5e8abf-7fb6-4bbf-826c-6d4c2f878ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb5e8abf-7fb6-4bbf-826c-6d4c2f878ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '265100fc-1bd7-4ea0-980e-59a729db6031', 'volume_name': 'volume-265100fc-1bd7-4ea0-980e-59a729db6031', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72350799-dd1d-44f7-b6d0-7a95032cb4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72350799-dd1d-44f7-b6d0-7a95032cb4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ed1865-fb5c-45a3-a199-d364dd9ffda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:31 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Volume 265100fc-1bd7-4ea0-980e-59a729db6031: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-265100fc-1bd7-4ea0-980e-59a729db6031', 'volume_size': 1} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=265100fc-1bd7-4ea0-980e-59a729db6031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df7bf91848744a9e9a4351831f026021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:31Z,use_quota=True,user_id='074efa29e48b4636bc065b1baf2b2c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Creating volume 265100fc-1bd7-4ea0-980e-59a729db6031 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:11:31 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-265100fc-1bd7-4ea0-980e-59a729db6031 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:31 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-265100fc-1bd7-4ea0-980e-59a729db6031 1073741824 Sep 21 12:11:31 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:31 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-265100fc-1bd7-4ea0-980e-59a729db6031 1073741824" returned: 0 in 0.512s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-265100fc-1bd7-4ea0-980e-59a729db6031 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:31 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-265100fc-1bd7-4ea0-980e-59a729db6031 Sep 21 12:11:31 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Flow 'volume_create_manager' (59f1647e-fcbf-4a2a-9951-c623e6b78eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba8bef14-63ac-419b-b800-913323877aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1ffde65e-8597-4534-9aeb-0ed7dcdc99be tempest-ProjectReaderTests-1777203705 None] Acquiring lock "cinder-f2ad72d1-b626-4379-8341-e963454a367c-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba8bef14-63ac-419b-b800-913323877aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1188587723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a26703-27a9-409d-89f2-c264a86919d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb8e58032794228b9717874dd335169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:32Z,use_quota=True,user_id='2c049c0e546f420296212675b08da21c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bafe905f-b441-462b-b54f-47a6bf0e4898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bafe905f-b441-462b-b54f-47a6bf0e4898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac24e1c-1e67-4827-8763-6adfdaa4d595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac24e1c-1e67-4827-8763-6adfdaa4d595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84a26703-27a9-409d-89f2-c264a86919d5', 'volume_name': 'volume-84a26703-27a9-409d-89f2-c264a86919d5', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd869bf1-d3bf-4fb6-8609-699ae9485602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd869bf1-d3bf-4fb6-8609-699ae9485602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da6eaae1-970e-4e99-a51d-5cc08bb3006f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:31 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Volume 84a26703-27a9-409d-89f2-c264a86919d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84a26703-27a9-409d-89f2-c264a86919d5', 'volume_size': 1} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:31 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1ffde65e-8597-4534-9aeb-0ed7dcdc99be tempest-ProjectReaderTests-1777203705 None] Lock "cinder-f2ad72d1-b626-4379-8341-e963454a367c-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1ffde65e-8597-4534-9aeb-0ed7dcdc99be tempest-ProjectReaderTests-1777203705 None] Acquiring lock "cinder-quobyte-f2ad72d1-b626-4379-8341-e963454a367c" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1ffde65e-8597-4534-9aeb-0ed7dcdc99be tempest-ProjectReaderTests-1777203705 None] Lock "cinder-quobyte-f2ad72d1-b626-4379-8341-e963454a367c" acquired by "delete_volume" :: waited 0.015s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0aa37ed-d985-4efc-bd5c-d72aa43ec960]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1ffde65e-8597-4534-9aeb-0ed7dcdc99be tempest-ProjectReaderTests-1777203705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f2ad72d1-b626-4379-8341-e963454a367c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:32 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-265100fc-1bd7-4ea0-980e-59a729db6031" returned: 0 in 0.320s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.170s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1188587723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a26703-27a9-409d-89f2-c264a86919d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb8e58032794228b9717874dd335169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:32Z,use_quota=True,user_id='2c049c0e546f420296212675b08da21c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Creating volume 84a26703-27a9-409d-89f2-c264a86919d5 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:11:32 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:32 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f2ad72d1-b626-4379-8341-e963454a367c Sep 21 12:11:32 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ed1865-fb5c-45a3-a199-d364dd9ffda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-265100fc-1bd7-4ea0-980e-59a729db6031', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:32 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5 1073741824 Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b1cee6-66cb-4f0f-8bb7-c14c7bdc7e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:32 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:32 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Volume volume-265100fc-1bd7-4ea0-980e-59a729db6031 (265100fc-1bd7-4ea0-980e-59a729db6031): created successfully Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b1cee6-66cb-4f0f-8bb7-c14c7bdc7e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Flow 'volume_create_manager' (59d0c1a1-a717-4fb2-b8f9-4b6d322b932d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:32 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-e9f8be08-6eb6-47ab-adb8-0c1cd2cacfac tempest-CinderUnicodeTest-2073349114 None] Created volume successfully. Sep 21 12:11:32 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1ffde65e-8597-4534-9aeb-0ed7dcdc99be tempest-ProjectReaderTests-1777203705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f2ad72d1-b626-4379-8341-e963454a367c" returned: 0 in 0.430s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1ffde65e-8597-4534-9aeb-0ed7dcdc99be tempest-ProjectReaderTests-1777203705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f2ad72d1-b626-4379-8341-e963454a367c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:32 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f2ad72d1-b626-4379-8341-e963454a367c Sep 21 12:11:32 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:32 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5 1073741824" returned: 0 in 0.443s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:32 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5 Sep 21 12:11:32 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:32 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1ffde65e-8597-4534-9aeb-0ed7dcdc99be tempest-ProjectReaderTests-1777203705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-f2ad72d1-b626-4379-8341-e963454a367c" returned: 0 in 0.276s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1ffde65e-8597-4534-9aeb-0ed7dcdc99be tempest-ProjectReaderTests-1777203705 None] Lock "cinder-quobyte-f2ad72d1-b626-4379-8341-e963454a367c" released by "delete_volume" :: held 0.755s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-1ffde65e-8597-4534-9aeb-0ed7dcdc99be tempest-ProjectReaderTests-1777203705 None] Created reservations ['d98ad460-76be-4ddc-8b9b-ef72705eb9ae', '1def15f8-39c9-48aa-8345-6bef31490a7a', '15937a02-31a8-4abf-b57d-45393eb74a13', '6a076f37-7031-4f06-83c6-c8c7c6ea4740'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:32 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5" returned: 0 in 0.273s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da6eaae1-970e-4e99-a51d-5cc08bb3006f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84a26703-27a9-409d-89f2-c264a86919d5', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e91a1805-34f1-4aec-98fe-556ae31c7e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:32 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Volume volume-84a26703-27a9-409d-89f2-c264a86919d5 (84a26703-27a9-409d-89f2-c264a86919d5): created successfully Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e91a1805-34f1-4aec-98fe-556ae31c7e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Flow 'volume_create_manager' (59f1647e-fcbf-4a2a-9951-c623e6b78eb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1ffde65e-8597-4534-9aeb-0ed7dcdc99be tempest-ProjectReaderTests-1777203705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1ffde65e-8597-4534-9aeb-0ed7dcdc99be tempest-ProjectReaderTests-1777203705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1ffde65e-8597-4534-9aeb-0ed7dcdc99be tempest-ProjectReaderTests-1777203705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-1ffde65e-8597-4534-9aeb-0ed7dcdc99be tempest-ProjectReaderTests-1777203705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1ffde65e-8597-4534-9aeb-0ed7dcdc99be tempest-ProjectReaderTests-1777203705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1ffde65e-8597-4534-9aeb-0ed7dcdc99be tempest-ProjectReaderTests-1777203705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:33 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-a96b6f7b-e22d-4db5-b325-902cc644d06e tempest-ProjectReaderTests-1840639123 None] Created volume successfully. Sep 21 12:11:33 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:11:33 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:33 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1ffde65e-8597-4534-9aeb-0ed7dcdc99be tempest-ProjectReaderTests-1777203705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.298s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:33 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-1ffde65e-8597-4534-9aeb-0ed7dcdc99be tempest-ProjectReaderTests-1777203705 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:11:33 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1ffde65e-8597-4534-9aeb-0ed7dcdc99be tempest-ProjectReaderTests-1777203705 None] Deleted volume successfully. Sep 21 12:11:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1ffde65e-8597-4534-9aeb-0ed7dcdc99be tempest-ProjectReaderTests-1777203705 None] Lock "cinder-f2ad72d1-b626-4379-8341-e963454a367c-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:33 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:11:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Flow 'volume_create_manager' (f82e47e9-884a-4cf7-a8b9-32b414700468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c1381c-08b5-4bf5-b78d-133de41c511d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c1381c-08b5-4bf5-b78d-133de41c511d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1042679340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac95529-61f2-414e-86d8-f1421a6cce45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df7bf91848744a9e9a4351831f026021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:34Z,use_quota=True,user_id='074efa29e48b4636bc065b1baf2b2c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4de6ad4b-76d0-4600-adc6-6d5e94d60749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4de6ad4b-76d0-4600-adc6-6d5e94d60749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e636634-ac42-48ee-959b-ab06ae810c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e636634-ac42-48ee-959b-ab06ae810c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ac95529-61f2-414e-86d8-f1421a6cce45', 'volume_name': 'volume-3ac95529-61f2-414e-86d8-f1421a6cce45', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (848d4e80-4a11-4f70-aa91-b03cf0aab01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (848d4e80-4a11-4f70-aa91-b03cf0aab01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:33 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a71e1153-e886-4090-8390-0992c7688a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:33 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Volume 3ac95529-61f2-414e-86d8-f1421a6cce45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ac95529-61f2-414e-86d8-f1421a6cce45', 'volume_size': 1} Sep 21 12:11:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1042679340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac95529-61f2-414e-86d8-f1421a6cce45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df7bf91848744a9e9a4351831f026021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:34Z,use_quota=True,user_id='074efa29e48b4636bc065b1baf2b2c7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:11:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Creating volume 3ac95529-61f2-414e-86d8-f1421a6cce45 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:11:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:33 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:11:33 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:11:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:33 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45 1073741824 Sep 21 12:11:33 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f73163b1-bd7b-4f19-bbae-ca2daf0ee1bb tempest-ProjectReaderTests-1840639123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:34 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45 1073741824" returned: 0 in 0.556s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:34 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45 Sep 21 12:11:34 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:34 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45" returned: 0 in 0.264s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:34 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:11:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f73163b1-bd7b-4f19-bbae-ca2daf0ee1bb tempest-ProjectReaderTests-1840639123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.609s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a71e1153-e886-4090-8390-0992c7688a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ac95529-61f2-414e-86d8-f1421a6cce45', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bee8caf-3b3c-49b9-9bf6-62ebfe258ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:34 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-f73163b1-bd7b-4f19-bbae-ca2daf0ee1bb tempest-ProjectReaderTests-1840639123 None] Creating offline snapshot 45864939-06fb-49f6-8ae6-df1975cb2706 of volume 84a26703-27a9-409d-89f2-c264a86919d5 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:11:34 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Volume volume-3ac95529-61f2-414e-86d8-f1421a6cce45 (3ac95529-61f2-414e-86d8-f1421a6cce45): created successfully Sep 21 12:11:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bee8caf-3b3c-49b9-9bf6-62ebfe258ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:34 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Flow 'volume_create_manager' (f82e47e9-884a-4cf7-a8b9-32b414700468) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:34 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25faa9d-aec0-4d65-948b-a62942784704]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f73163b1-bd7b-4f19-bbae-ca2daf0ee1bb tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:34 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-3d578550-bf66-4cbc-8775-9e144eed2f78 tempest-CinderUnicodeTest-2073349114 None] Created volume successfully. Sep 21 12:11:35 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5 Sep 21 12:11:35 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:35 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f73163b1-bd7b-4f19-bbae-ca2daf0ee1bb tempest-ProjectReaderTests-1840639123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5" returned: 0 in 0.386s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f73163b1-bd7b-4f19-bbae-ca2daf0ee1bb tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5.45864939-06fb-49f6-8ae6-df1975cb2706 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:35 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5.45864939-06fb-49f6-8ae6-df1975cb2706 1G Sep 21 12:11:35 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:35 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f73163b1-bd7b-4f19-bbae-ca2daf0ee1bb tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5.45864939-06fb-49f6-8ae6-df1975cb2706 1G" returned: 0 in 0.398s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f73163b1-bd7b-4f19-bbae-ca2daf0ee1bb tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84a26703-27a9-409d-89f2-c264a86919d5 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5.45864939-06fb-49f6-8ae6-df1975cb2706 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:35 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84a26703-27a9-409d-89f2-c264a86919d5 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5.45864939-06fb-49f6-8ae6-df1975cb2706 Sep 21 12:11:35 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:35 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f73163b1-bd7b-4f19-bbae-ca2daf0ee1bb tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84a26703-27a9-409d-89f2-c264a86919d5 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5.45864939-06fb-49f6-8ae6-df1975cb2706" returned: 0 in 0.310s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:35 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-f73163b1-bd7b-4f19-bbae-ca2daf0ee1bb tempest-ProjectReaderTests-1840639123 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5.45864939-06fb-49f6-8ae6-df1975cb2706 is being set with open permissions: ugo+rw Sep 21 12:11:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f73163b1-bd7b-4f19-bbae-ca2daf0ee1bb tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5.45864939-06fb-49f6-8ae6-df1975cb2706 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:36 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5.45864939-06fb-49f6-8ae6-df1975cb2706 Sep 21 12:11:36 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7b2daaa8-0649-407a-8e99-3b9068a02799 tempest-CinderUnicodeTest-2073349114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:36 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f73163b1-bd7b-4f19-bbae-ca2daf0ee1bb tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5.45864939-06fb-49f6-8ae6-df1975cb2706" returned: 0 in 0.293s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f73163b1-bd7b-4f19-bbae-ca2daf0ee1bb tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:36 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5.info Sep 21 12:11:36 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:36 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f73163b1-bd7b-4f19-bbae-ca2daf0ee1bb tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5.info" returned: 0 in 0.247s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:36 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-f73163b1-bd7b-4f19-bbae-ca2daf0ee1bb tempest-ProjectReaderTests-1840639123 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5.info is being set with open permissions: ugo+rw Sep 21 12:11:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f73163b1-bd7b-4f19-bbae-ca2daf0ee1bb tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:36 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5.info Sep 21 12:11:36 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:36 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-f73163b1-bd7b-4f19-bbae-ca2daf0ee1bb tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5.info" returned: 0 in 0.233s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-f73163b1-bd7b-4f19-bbae-ca2daf0ee1bb tempest-ProjectReaderTests-1840639123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.988s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7b2daaa8-0649-407a-8e99-3b9068a02799 tempest-CinderUnicodeTest-2073349114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.632s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:36 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-7b2daaa8-0649-407a-8e99-3b9068a02799 tempest-CinderUnicodeTest-2073349114 None] Creating offline snapshot d1a3a61e-c548-48b0-9fa6-9d6499e04838 of volume 3ac95529-61f2-414e-86d8-f1421a6cce45 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:11:36 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-f73163b1-bd7b-4f19-bbae-ca2daf0ee1bb tempest-ProjectReaderTests-1840639123 None] Create snapshot completed successfully Sep 21 12:11:36 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0205ec9-7349-4fbe-bc85-4c682b4df48d]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7b2daaa8-0649-407a-8e99-3b9068a02799 tempest-CinderUnicodeTest-2073349114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:36 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45 Sep 21 12:11:36 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:37 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7b2daaa8-0649-407a-8e99-3b9068a02799 tempest-CinderUnicodeTest-2073349114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45" returned: 0 in 0.365s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7b2daaa8-0649-407a-8e99-3b9068a02799 tempest-CinderUnicodeTest-2073349114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45.d1a3a61e-c548-48b0-9fa6-9d6499e04838 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:37 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45.d1a3a61e-c548-48b0-9fa6-9d6499e04838 1G Sep 21 12:11:37 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7b89dfd4-a6c7-471c-b4ea-83450af3acb1 tempest-ProjectReaderTests-1840639123 None] Acquiring lock "cinder-45864939-06fb-49f6-8ae6-df1975cb2706-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7b89dfd4-a6c7-471c-b4ea-83450af3acb1 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-45864939-06fb-49f6-8ae6-df1975cb2706-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7b89dfd4-a6c7-471c-b4ea-83450af3acb1 tempest-ProjectReaderTests-1840639123 None] Acquiring lock "cinder-quobyte-84a26703-27a9-409d-89f2-c264a86919d5" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7b89dfd4-a6c7-471c-b4ea-83450af3acb1 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-84a26703-27a9-409d-89f2-c264a86919d5" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7b89dfd4-a6c7-471c-b4ea-83450af3acb1 tempest-ProjectReaderTests-1840639123 None] Acquiring lock "cinder-quobyte-45864939-06fb-49f6-8ae6-df1975cb2706" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:37 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7b89dfd4-a6c7-471c-b4ea-83450af3acb1 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-45864939-06fb-49f6-8ae6-df1975cb2706" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:37 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-7b89dfd4-a6c7-471c-b4ea-83450af3acb1 tempest-ProjectReaderTests-1840639123 None] Deleting offline snapshot 45864939-06fb-49f6-8ae6-df1975cb2706 of volume 84a26703-27a9-409d-89f2-c264a86919d5 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:11:37 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-7b89dfd4-a6c7-471c-b4ea-83450af3acb1 tempest-ProjectReaderTests-1840639123 None] snapshot_file for this snap is: volume-84a26703-27a9-409d-89f2-c264a86919d5.45864939-06fb-49f6-8ae6-df1975cb2706 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:11:37 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ca9c49-68e5-4a8e-b734-a01626de52ed]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7b89dfd4-a6c7-471c-b4ea-83450af3acb1 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5.45864939-06fb-49f6-8ae6-df1975cb2706 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:37 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5.45864939-06fb-49f6-8ae6-df1975cb2706 Sep 21 12:11:37 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:37 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7b2daaa8-0649-407a-8e99-3b9068a02799 tempest-CinderUnicodeTest-2073349114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45.d1a3a61e-c548-48b0-9fa6-9d6499e04838 1G" returned: 0 in 0.435s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7b2daaa8-0649-407a-8e99-3b9068a02799 tempest-CinderUnicodeTest-2073349114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ac95529-61f2-414e-86d8-f1421a6cce45 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45.d1a3a61e-c548-48b0-9fa6-9d6499e04838 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:37 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ac95529-61f2-414e-86d8-f1421a6cce45 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45.d1a3a61e-c548-48b0-9fa6-9d6499e04838 Sep 21 12:11:37 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:37 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7b89dfd4-a6c7-471c-b4ea-83450af3acb1 tempest-ProjectReaderTests-1840639123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5.45864939-06fb-49f6-8ae6-df1975cb2706" returned: 0 in 0.385s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:37 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-7b89dfd4-a6c7-471c-b4ea-83450af3acb1 tempest-ProjectReaderTests-1840639123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84a26703-27a9-409d-89f2-c264a86919d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:11:37 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[796a2672-1e85-4df7-bdb1-d3137bd541f0]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7b89dfd4-a6c7-471c-b4ea-83450af3acb1 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:37 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7b2daaa8-0649-407a-8e99-3b9068a02799 tempest-CinderUnicodeTest-2073349114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ac95529-61f2-414e-86d8-f1421a6cce45 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45.d1a3a61e-c548-48b0-9fa6-9d6499e04838" returned: 0 in 0.307s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:37 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-7b2daaa8-0649-407a-8e99-3b9068a02799 tempest-CinderUnicodeTest-2073349114 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45.d1a3a61e-c548-48b0-9fa6-9d6499e04838 is being set with open permissions: ugo+rw Sep 21 12:11:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7b2daaa8-0649-407a-8e99-3b9068a02799 tempest-CinderUnicodeTest-2073349114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45.d1a3a61e-c548-48b0-9fa6-9d6499e04838 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:37 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45.d1a3a61e-c548-48b0-9fa6-9d6499e04838 Sep 21 12:11:37 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:38 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5 Sep 21 12:11:38 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:38 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7b2daaa8-0649-407a-8e99-3b9068a02799 tempest-CinderUnicodeTest-2073349114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45.d1a3a61e-c548-48b0-9fa6-9d6499e04838" returned: 0 in 0.254s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7b2daaa8-0649-407a-8e99-3b9068a02799 tempest-CinderUnicodeTest-2073349114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:38 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:38 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45.info Sep 21 12:11:38 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7b89dfd4-a6c7-471c-b4ea-83450af3acb1 tempest-ProjectReaderTests-1840639123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5" returned: 0 in 0.373s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7b89dfd4-a6c7-471c-b4ea-83450af3acb1 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5.45864939-06fb-49f6-8ae6-df1975cb2706 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:38 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5.45864939-06fb-49f6-8ae6-df1975cb2706 Sep 21 12:11:38 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:38 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7b2daaa8-0649-407a-8e99-3b9068a02799 tempest-CinderUnicodeTest-2073349114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45.info" returned: 0 in 0.256s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:38 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-7b2daaa8-0649-407a-8e99-3b9068a02799 tempest-CinderUnicodeTest-2073349114 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45.info is being set with open permissions: ugo+rw Sep 21 12:11:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7b2daaa8-0649-407a-8e99-3b9068a02799 tempest-CinderUnicodeTest-2073349114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:38 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45.info Sep 21 12:11:38 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:38 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7b89dfd4-a6c7-471c-b4ea-83450af3acb1 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5.45864939-06fb-49f6-8ae6-df1975cb2706" returned: 0 in 0.369s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7b89dfd4-a6c7-471c-b4ea-83450af3acb1 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5.45864939-06fb-49f6-8ae6-df1975cb2706 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:38 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5.45864939-06fb-49f6-8ae6-df1975cb2706 Sep 21 12:11:38 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:38 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7b2daaa8-0649-407a-8e99-3b9068a02799 tempest-CinderUnicodeTest-2073349114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45.info" returned: 0 in 0.241s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-7b2daaa8-0649-407a-8e99-3b9068a02799 tempest-CinderUnicodeTest-2073349114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.959s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:38 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-7b2daaa8-0649-407a-8e99-3b9068a02799 tempest-CinderUnicodeTest-2073349114 None] Create snapshot completed successfully Sep 21 12:11:38 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7b89dfd4-a6c7-471c-b4ea-83450af3acb1 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5.45864939-06fb-49f6-8ae6-df1975cb2706" returned: 0 in 0.253s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7b89dfd4-a6c7-471c-b4ea-83450af3acb1 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-45864939-06fb-49f6-8ae6-df1975cb2706" released by "_delete_snapshot" :: held 1.493s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:38 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7b89dfd4-a6c7-471c-b4ea-83450af3acb1 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-84a26703-27a9-409d-89f2-c264a86919d5" released by "delete_snapshot" :: held 1.513s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:38 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-7b89dfd4-a6c7-471c-b4ea-83450af3acb1 tempest-ProjectReaderTests-1840639123 None] Created reservations ['78dd4c1c-d1d1-4ae7-badb-c6e93a66a3d9', 'ad928702-2816-408f-9bca-62e103ef9536', '02a41cce-54ab-4a8f-8606-908b1b4d3f4a', 'b9e7b7be-fcde-4e74-b1a7-a233629b1a19'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:39 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-7b89dfd4-a6c7-471c-b4ea-83450af3acb1 tempest-ProjectReaderTests-1840639123 None] Delete snapshot completed successfully. Sep 21 12:11:39 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7b89dfd4-a6c7-471c-b4ea-83450af3acb1 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-45864939-06fb-49f6-8ae6-df1975cb2706-delete_snapshot" released by "delete_snapshot" :: held 1.638s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:39 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4f7bccde-e910-4a0b-b84d-4090a60d7278 tempest-CinderUnicodeTest-2073349114 None] Acquiring lock "cinder-d1a3a61e-c548-48b0-9fa6-9d6499e04838-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:39 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4f7bccde-e910-4a0b-b84d-4090a60d7278 tempest-CinderUnicodeTest-2073349114 None] Lock "cinder-d1a3a61e-c548-48b0-9fa6-9d6499e04838-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:39 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4f7bccde-e910-4a0b-b84d-4090a60d7278 tempest-CinderUnicodeTest-2073349114 None] Acquiring lock "cinder-quobyte-3ac95529-61f2-414e-86d8-f1421a6cce45" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:39 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4f7bccde-e910-4a0b-b84d-4090a60d7278 tempest-CinderUnicodeTest-2073349114 None] Lock "cinder-quobyte-3ac95529-61f2-414e-86d8-f1421a6cce45" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:39 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4f7bccde-e910-4a0b-b84d-4090a60d7278 tempest-CinderUnicodeTest-2073349114 None] Acquiring lock "cinder-quobyte-d1a3a61e-c548-48b0-9fa6-9d6499e04838" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:39 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4f7bccde-e910-4a0b-b84d-4090a60d7278 tempest-CinderUnicodeTest-2073349114 None] Lock "cinder-quobyte-d1a3a61e-c548-48b0-9fa6-9d6499e04838" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:39 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-4f7bccde-e910-4a0b-b84d-4090a60d7278 tempest-CinderUnicodeTest-2073349114 None] Deleting offline snapshot d1a3a61e-c548-48b0-9fa6-9d6499e04838 of volume 3ac95529-61f2-414e-86d8-f1421a6cce45 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:11:39 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-4f7bccde-e910-4a0b-b84d-4090a60d7278 tempest-CinderUnicodeTest-2073349114 None] snapshot_file for this snap is: volume-3ac95529-61f2-414e-86d8-f1421a6cce45.d1a3a61e-c548-48b0-9fa6-9d6499e04838 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:11:39 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de89ed8-3455-46fb-a022-155f518f6b48]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4f7bccde-e910-4a0b-b84d-4090a60d7278 tempest-CinderUnicodeTest-2073349114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45.d1a3a61e-c548-48b0-9fa6-9d6499e04838 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:39 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45.d1a3a61e-c548-48b0-9fa6-9d6499e04838 Sep 21 12:11:39 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:39 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-46f5a4a0-b77a-468e-b803-63dcbe3121bc tempest-ProjectReaderTests-1840639123 None] Acquiring lock "cinder-84a26703-27a9-409d-89f2-c264a86919d5-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:39 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-46f5a4a0-b77a-468e-b803-63dcbe3121bc tempest-ProjectReaderTests-1840639123 None] Lock "cinder-84a26703-27a9-409d-89f2-c264a86919d5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:39 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-46f5a4a0-b77a-468e-b803-63dcbe3121bc tempest-ProjectReaderTests-1840639123 None] Acquiring lock "cinder-quobyte-84a26703-27a9-409d-89f2-c264a86919d5" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:39 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-46f5a4a0-b77a-468e-b803-63dcbe3121bc tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-84a26703-27a9-409d-89f2-c264a86919d5" acquired by "delete_volume" :: waited 0.018s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:39 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9012cf-a91b-49a1-8382-001c2bfed400]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-46f5a4a0-b77a-468e-b803-63dcbe3121bc tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:39 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5 Sep 21 12:11:39 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:39 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4f7bccde-e910-4a0b-b84d-4090a60d7278 tempest-CinderUnicodeTest-2073349114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45.d1a3a61e-c548-48b0-9fa6-9d6499e04838" returned: 0 in 0.417s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:39 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-4f7bccde-e910-4a0b-b84d-4090a60d7278 tempest-CinderUnicodeTest-2073349114 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ac95529-61f2-414e-86d8-f1421a6cce45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:11:39 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[941aef9b-346b-4da5-a725-785a5ceaa3dc]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4f7bccde-e910-4a0b-b84d-4090a60d7278 tempest-CinderUnicodeTest-2073349114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:39 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45 Sep 21 12:11:39 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:40 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-46f5a4a0-b77a-468e-b803-63dcbe3121bc tempest-ProjectReaderTests-1840639123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5" returned: 0 in 0.409s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-46f5a4a0-b77a-468e-b803-63dcbe3121bc tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:40 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5 Sep 21 12:11:40 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:40 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4f7bccde-e910-4a0b-b84d-4090a60d7278 tempest-CinderUnicodeTest-2073349114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45" returned: 0 in 0.377s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4f7bccde-e910-4a0b-b84d-4090a60d7278 tempest-CinderUnicodeTest-2073349114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45.d1a3a61e-c548-48b0-9fa6-9d6499e04838 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:40 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45.d1a3a61e-c548-48b0-9fa6-9d6499e04838 Sep 21 12:11:40 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:40 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-46f5a4a0-b77a-468e-b803-63dcbe3121bc tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-84a26703-27a9-409d-89f2-c264a86919d5" returned: 0 in 0.324s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-46f5a4a0-b77a-468e-b803-63dcbe3121bc tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-84a26703-27a9-409d-89f2-c264a86919d5" released by "delete_volume" :: held 0.808s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:40 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-46f5a4a0-b77a-468e-b803-63dcbe3121bc tempest-ProjectReaderTests-1840639123 None] Created reservations ['ad1a7095-2a71-43fb-8af6-45a0a5f4b02d', 'e6a447f0-4f49-415f-826a-66aff0b00aec', 'fd8f7dd8-0a6d-40af-a945-3ffdd7303d3a', '1a30e100-9790-4d70-b4c0-4eef2db260cc'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-46f5a4a0-b77a-468e-b803-63dcbe3121bc tempest-ProjectReaderTests-1840639123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-46f5a4a0-b77a-468e-b803-63dcbe3121bc tempest-ProjectReaderTests-1840639123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:40 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-46f5a4a0-b77a-468e-b803-63dcbe3121bc tempest-ProjectReaderTests-1840639123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:40 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-46f5a4a0-b77a-468e-b803-63dcbe3121bc tempest-ProjectReaderTests-1840639123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-46f5a4a0-b77a-468e-b803-63dcbe3121bc tempest-ProjectReaderTests-1840639123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-46f5a4a0-b77a-468e-b803-63dcbe3121bc tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:40 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:11:40 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:40 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4f7bccde-e910-4a0b-b84d-4090a60d7278 tempest-CinderUnicodeTest-2073349114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45.d1a3a61e-c548-48b0-9fa6-9d6499e04838" returned: 0 in 0.370s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4f7bccde-e910-4a0b-b84d-4090a60d7278 tempest-CinderUnicodeTest-2073349114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45.d1a3a61e-c548-48b0-9fa6-9d6499e04838 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:40 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45.d1a3a61e-c548-48b0-9fa6-9d6499e04838 Sep 21 12:11:40 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:40 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-46f5a4a0-b77a-468e-b803-63dcbe3121bc tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.269s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:40 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-46f5a4a0-b77a-468e-b803-63dcbe3121bc tempest-ProjectReaderTests-1840639123 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:11:40 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-46f5a4a0-b77a-468e-b803-63dcbe3121bc tempest-ProjectReaderTests-1840639123 None] Deleted volume successfully. Sep 21 12:11:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-46f5a4a0-b77a-468e-b803-63dcbe3121bc tempest-ProjectReaderTests-1840639123 None] Lock "cinder-84a26703-27a9-409d-89f2-c264a86919d5-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:40 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4f7bccde-e910-4a0b-b84d-4090a60d7278 tempest-CinderUnicodeTest-2073349114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45.d1a3a61e-c548-48b0-9fa6-9d6499e04838" returned: 0 in 0.293s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4f7bccde-e910-4a0b-b84d-4090a60d7278 tempest-CinderUnicodeTest-2073349114 None] Lock "cinder-quobyte-d1a3a61e-c548-48b0-9fa6-9d6499e04838" released by "_delete_snapshot" :: held 1.585s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:40 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4f7bccde-e910-4a0b-b84d-4090a60d7278 tempest-CinderUnicodeTest-2073349114 None] Lock "cinder-quobyte-3ac95529-61f2-414e-86d8-f1421a6cce45" released by "delete_snapshot" :: held 1.611s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-4f7bccde-e910-4a0b-b84d-4090a60d7278 tempest-CinderUnicodeTest-2073349114 None] Created reservations ['f03bc109-ce49-4218-9264-50e0e00aaa75', '0076bf4c-31ad-4700-b7ca-8622e7a43df1', '764e98cd-c109-4ef2-8a7d-26c696e0bf1b', 'ef4cc673-5285-4cd3-a67e-d08bea88c78f'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:41 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-4f7bccde-e910-4a0b-b84d-4090a60d7278 tempest-CinderUnicodeTest-2073349114 None] Delete snapshot completed successfully. Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4f7bccde-e910-4a0b-b84d-4090a60d7278 tempest-CinderUnicodeTest-2073349114 None] Lock "cinder-d1a3a61e-c548-48b0-9fa6-9d6499e04838-delete_snapshot" released by "delete_snapshot" :: held 1.797s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Flow 'volume_create_manager' (ee5b24e8-ec5a-44bf-a7cb-bcc7508a6460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7582f400-1c9d-4f72-ac44-b18251593232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7582f400-1c9d-4f72-ac44-b18251593232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-168260666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7798ff01-5144-426c-944b-7774635b72b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb8e58032794228b9717874dd335169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:41Z,use_quota=True,user_id='2c049c0e546f420296212675b08da21c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (789588d3-480d-4fda-90ea-6812f8aef44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (789588d3-480d-4fda-90ea-6812f8aef44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (095990f8-742f-4da8-be38-b22399e2a2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (095990f8-742f-4da8-be38-b22399e2a2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7798ff01-5144-426c-944b-7774635b72b7', 'volume_name': 'volume-7798ff01-5144-426c-944b-7774635b72b7', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b837a6a1-053c-4e16-bde4-1b4bfdf4d3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b837a6a1-053c-4e16-bde4-1b4bfdf4d3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe332b52-4ef0-4a84-a9a0-19a09858e382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:41 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Volume 7798ff01-5144-426c-944b-7774635b72b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7798ff01-5144-426c-944b-7774635b72b7', 'volume_size': 1} Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-168260666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7798ff01-5144-426c-944b-7774635b72b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb8e58032794228b9717874dd335169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:41Z,use_quota=True,user_id='2c049c0e546f420296212675b08da21c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Creating volume 7798ff01-5144-426c-944b-7774635b72b7 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:11:41 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:41 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7 1073741824 Sep 21 12:11:41 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-66c36783-42b2-4411-8f3f-9f18225308e8 tempest-CinderUnicodeTest-2073349114 None] Acquiring lock "cinder-3ac95529-61f2-414e-86d8-f1421a6cce45-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-66c36783-42b2-4411-8f3f-9f18225308e8 tempest-CinderUnicodeTest-2073349114 None] Lock "cinder-3ac95529-61f2-414e-86d8-f1421a6cce45-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-66c36783-42b2-4411-8f3f-9f18225308e8 tempest-CinderUnicodeTest-2073349114 None] Acquiring lock "cinder-quobyte-3ac95529-61f2-414e-86d8-f1421a6cce45" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-66c36783-42b2-4411-8f3f-9f18225308e8 tempest-CinderUnicodeTest-2073349114 None] Lock "cinder-quobyte-3ac95529-61f2-414e-86d8-f1421a6cce45" acquired by "delete_volume" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ef767f-6b8c-443e-8e8e-f9013505c8bc]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-66c36783-42b2-4411-8f3f-9f18225308e8 tempest-CinderUnicodeTest-2073349114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:41 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45 Sep 21 12:11:41 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:41 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7 1073741824" returned: 0 in 0.457s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:41 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7 Sep 21 12:11:41 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:42 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-66c36783-42b2-4411-8f3f-9f18225308e8 tempest-CinderUnicodeTest-2073349114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45" returned: 0 in 0.406s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-66c36783-42b2-4411-8f3f-9f18225308e8 tempest-CinderUnicodeTest-2073349114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:42 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45 Sep 21 12:11:42 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:42 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7" returned: 0 in 0.258s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe332b52-4ef0-4a84-a9a0-19a09858e382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7798ff01-5144-426c-944b-7774635b72b7', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73e5e58e-9a9a-4c38-b548-97ff40144582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:42 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Volume volume-7798ff01-5144-426c-944b-7774635b72b7 (7798ff01-5144-426c-944b-7774635b72b7): created successfully Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73e5e58e-9a9a-4c38-b548-97ff40144582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Flow 'volume_create_manager' (ee5b24e8-ec5a-44bf-a7cb-bcc7508a6460) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:42 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-fdc3e1eb-2272-4f26-9956-1fd0a1f07c39 tempest-ProjectReaderTests-1840639123 None] Created volume successfully. Sep 21 12:11:42 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-66c36783-42b2-4411-8f3f-9f18225308e8 tempest-CinderUnicodeTest-2073349114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-3ac95529-61f2-414e-86d8-f1421a6cce45" returned: 0 in 0.285s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-66c36783-42b2-4411-8f3f-9f18225308e8 tempest-CinderUnicodeTest-2073349114 None] Lock "cinder-quobyte-3ac95529-61f2-414e-86d8-f1421a6cce45" released by "delete_volume" :: held 0.775s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-66c36783-42b2-4411-8f3f-9f18225308e8 tempest-CinderUnicodeTest-2073349114 None] Created reservations ['84c08881-b6bf-4860-bc23-1641cd119f84', '8e9d6885-e596-4e87-ad6f-adc7a55c5e27', '5afca888-2ed3-4663-82e8-c70277561290', 'eeaa10b2-72f5-4d29-927c-888a94f10e45'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1bfbd091-8325-41c1-abd7-3e2f49cc10e6 tempest-ProjectReaderTests-1840639123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1bfbd091-8325-41c1-abd7-3e2f49cc10e6 tempest-ProjectReaderTests-1840639123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1bfbd091-8325-41c1-abd7-3e2f49cc10e6 tempest-ProjectReaderTests-1840639123 None] Creating offline snapshot d2b75f7f-2c70-47f8-9c3b-f36e51763d03 of volume 7798ff01-5144-426c-944b-7774635b72b7 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7754b0-0ab6-4d63-9729-f6f4cdd366e4]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1bfbd091-8325-41c1-abd7-3e2f49cc10e6 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-66c36783-42b2-4411-8f3f-9f18225308e8 tempest-CinderUnicodeTest-2073349114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-66c36783-42b2-4411-8f3f-9f18225308e8 tempest-CinderUnicodeTest-2073349114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-66c36783-42b2-4411-8f3f-9f18225308e8 tempest-CinderUnicodeTest-2073349114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-66c36783-42b2-4411-8f3f-9f18225308e8 tempest-CinderUnicodeTest-2073349114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-66c36783-42b2-4411-8f3f-9f18225308e8 tempest-CinderUnicodeTest-2073349114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-66c36783-42b2-4411-8f3f-9f18225308e8 tempest-CinderUnicodeTest-2073349114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:42 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:11:42 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:42 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7 Sep 21 12:11:42 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9384ec86-6910-4e33-b0e7-a00a95055261 tempest-CinderUnicodeTest-2073349114 None] Acquiring lock "cinder-265100fc-1bd7-4ea0-980e-59a729db6031-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9384ec86-6910-4e33-b0e7-a00a95055261 tempest-CinderUnicodeTest-2073349114 None] Lock "cinder-265100fc-1bd7-4ea0-980e-59a729db6031-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9384ec86-6910-4e33-b0e7-a00a95055261 tempest-CinderUnicodeTest-2073349114 None] Acquiring lock "cinder-quobyte-265100fc-1bd7-4ea0-980e-59a729db6031" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9384ec86-6910-4e33-b0e7-a00a95055261 tempest-CinderUnicodeTest-2073349114 None] Lock "cinder-quobyte-265100fc-1bd7-4ea0-980e-59a729db6031" acquired by "delete_volume" :: waited 0.024s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02550ee-ca0f-41e6-bf94-5a4b18742688]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9384ec86-6910-4e33-b0e7-a00a95055261 tempest-CinderUnicodeTest-2073349114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-265100fc-1bd7-4ea0-980e-59a729db6031 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:42 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-66c36783-42b2-4411-8f3f-9f18225308e8 tempest-CinderUnicodeTest-2073349114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.304s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-66c36783-42b2-4411-8f3f-9f18225308e8 tempest-CinderUnicodeTest-2073349114 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:11:42 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-66c36783-42b2-4411-8f3f-9f18225308e8 tempest-CinderUnicodeTest-2073349114 None] Deleted volume successfully. Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-66c36783-42b2-4411-8f3f-9f18225308e8 tempest-CinderUnicodeTest-2073349114 None] Lock "cinder-3ac95529-61f2-414e-86d8-f1421a6cce45-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:42 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1bfbd091-8325-41c1-abd7-3e2f49cc10e6 tempest-ProjectReaderTests-1840639123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7" returned: 0 in 0.456s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1bfbd091-8325-41c1-abd7-3e2f49cc10e6 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7.d2b75f7f-2c70-47f8-9c3b-f36e51763d03 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:42 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-265100fc-1bd7-4ea0-980e-59a729db6031 Sep 21 12:11:42 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:42 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7.d2b75f7f-2c70-47f8-9c3b-f36e51763d03 1G Sep 21 12:11:42 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:43 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9384ec86-6910-4e33-b0e7-a00a95055261 tempest-CinderUnicodeTest-2073349114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-265100fc-1bd7-4ea0-980e-59a729db6031" returned: 0 in 0.396s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9384ec86-6910-4e33-b0e7-a00a95055261 tempest-CinderUnicodeTest-2073349114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-265100fc-1bd7-4ea0-980e-59a729db6031 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:43 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-265100fc-1bd7-4ea0-980e-59a729db6031 Sep 21 12:11:43 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:43 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1bfbd091-8325-41c1-abd7-3e2f49cc10e6 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7.d2b75f7f-2c70-47f8-9c3b-f36e51763d03 1G" returned: 0 in 0.437s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1bfbd091-8325-41c1-abd7-3e2f49cc10e6 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7798ff01-5144-426c-944b-7774635b72b7 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7.d2b75f7f-2c70-47f8-9c3b-f36e51763d03 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:43 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7798ff01-5144-426c-944b-7774635b72b7 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7.d2b75f7f-2c70-47f8-9c3b-f36e51763d03 Sep 21 12:11:43 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:43 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9384ec86-6910-4e33-b0e7-a00a95055261 tempest-CinderUnicodeTest-2073349114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-265100fc-1bd7-4ea0-980e-59a729db6031" returned: 0 in 0.266s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:43 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9384ec86-6910-4e33-b0e7-a00a95055261 tempest-CinderUnicodeTest-2073349114 None] Lock "cinder-quobyte-265100fc-1bd7-4ea0-980e-59a729db6031" released by "delete_volume" :: held 0.719s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:43 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-9384ec86-6910-4e33-b0e7-a00a95055261 tempest-CinderUnicodeTest-2073349114 None] Created reservations ['05d523c7-8ed3-4bc3-9725-fbc4debd8e04', '9cc54b74-3372-47e2-b220-adf231fce976', 'fb97b054-9336-46d1-8ef8-27d52daad7e9', 'aa0f71d1-fab7-4d05-b210-05d546a6dd51'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9384ec86-6910-4e33-b0e7-a00a95055261 tempest-CinderUnicodeTest-2073349114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9384ec86-6910-4e33-b0e7-a00a95055261 tempest-CinderUnicodeTest-2073349114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:43 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9384ec86-6910-4e33-b0e7-a00a95055261 tempest-CinderUnicodeTest-2073349114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:43 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9384ec86-6910-4e33-b0e7-a00a95055261 tempest-CinderUnicodeTest-2073349114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9384ec86-6910-4e33-b0e7-a00a95055261 tempest-CinderUnicodeTest-2073349114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9384ec86-6910-4e33-b0e7-a00a95055261 tempest-CinderUnicodeTest-2073349114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:43 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:11:43 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:43 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1bfbd091-8325-41c1-abd7-3e2f49cc10e6 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7798ff01-5144-426c-944b-7774635b72b7 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7.d2b75f7f-2c70-47f8-9c3b-f36e51763d03" returned: 0 in 0.343s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:43 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-1bfbd091-8325-41c1-abd7-3e2f49cc10e6 tempest-ProjectReaderTests-1840639123 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7.d2b75f7f-2c70-47f8-9c3b-f36e51763d03 is being set with open permissions: ugo+rw Sep 21 12:11:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1bfbd091-8325-41c1-abd7-3e2f49cc10e6 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7.d2b75f7f-2c70-47f8-9c3b-f36e51763d03 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:43 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7.d2b75f7f-2c70-47f8-9c3b-f36e51763d03 Sep 21 12:11:43 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:43 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9384ec86-6910-4e33-b0e7-a00a95055261 tempest-CinderUnicodeTest-2073349114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.267s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:43 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-9384ec86-6910-4e33-b0e7-a00a95055261 tempest-CinderUnicodeTest-2073349114 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:11:43 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-9384ec86-6910-4e33-b0e7-a00a95055261 tempest-CinderUnicodeTest-2073349114 None] Deleted volume successfully. Sep 21 12:11:43 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9384ec86-6910-4e33-b0e7-a00a95055261 tempest-CinderUnicodeTest-2073349114 None] Lock "cinder-265100fc-1bd7-4ea0-980e-59a729db6031-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:43 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1bfbd091-8325-41c1-abd7-3e2f49cc10e6 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7.d2b75f7f-2c70-47f8-9c3b-f36e51763d03" returned: 0 in 0.258s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1bfbd091-8325-41c1-abd7-3e2f49cc10e6 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:44 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7.info Sep 21 12:11:44 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:44 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1bfbd091-8325-41c1-abd7-3e2f49cc10e6 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7.info" returned: 0 in 0.264s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:44 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-1bfbd091-8325-41c1-abd7-3e2f49cc10e6 tempest-ProjectReaderTests-1840639123 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7.info is being set with open permissions: ugo+rw Sep 21 12:11:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1bfbd091-8325-41c1-abd7-3e2f49cc10e6 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:44 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7.info Sep 21 12:11:44 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:44 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1bfbd091-8325-41c1-abd7-3e2f49cc10e6 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7.info" returned: 0 in 0.257s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-1bfbd091-8325-41c1-abd7-3e2f49cc10e6 tempest-ProjectReaderTests-1840639123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.115s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:44 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1bfbd091-8325-41c1-abd7-3e2f49cc10e6 tempest-ProjectReaderTests-1840639123 None] Create snapshot completed successfully Sep 21 12:11:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-cb61f031-5f3a-4b77-9731-15cfd305b7e5 tempest-ProjectReaderTests-1840639123 None] Acquiring lock "cinder-d2b75f7f-2c70-47f8-9c3b-f36e51763d03-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-cb61f031-5f3a-4b77-9731-15cfd305b7e5 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-d2b75f7f-2c70-47f8-9c3b-f36e51763d03-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-cb61f031-5f3a-4b77-9731-15cfd305b7e5 tempest-ProjectReaderTests-1840639123 None] Acquiring lock "cinder-quobyte-7798ff01-5144-426c-944b-7774635b72b7" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-cb61f031-5f3a-4b77-9731-15cfd305b7e5 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-7798ff01-5144-426c-944b-7774635b72b7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-cb61f031-5f3a-4b77-9731-15cfd305b7e5 tempest-ProjectReaderTests-1840639123 None] Acquiring lock "cinder-quobyte-d2b75f7f-2c70-47f8-9c3b-f36e51763d03" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:45 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-cb61f031-5f3a-4b77-9731-15cfd305b7e5 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-d2b75f7f-2c70-47f8-9c3b-f36e51763d03" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-cb61f031-5f3a-4b77-9731-15cfd305b7e5 tempest-ProjectReaderTests-1840639123 None] Deleting offline snapshot d2b75f7f-2c70-47f8-9c3b-f36e51763d03 of volume 7798ff01-5144-426c-944b-7774635b72b7 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:11:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-cb61f031-5f3a-4b77-9731-15cfd305b7e5 tempest-ProjectReaderTests-1840639123 None] snapshot_file for this snap is: volume-7798ff01-5144-426c-944b-7774635b72b7.d2b75f7f-2c70-47f8-9c3b-f36e51763d03 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:11:45 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f147f0-9098-4de8-a216-779fa7e93c7d]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-cb61f031-5f3a-4b77-9731-15cfd305b7e5 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7.d2b75f7f-2c70-47f8-9c3b-f36e51763d03 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:45 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7.d2b75f7f-2c70-47f8-9c3b-f36e51763d03 Sep 21 12:11:45 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:46 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-cb61f031-5f3a-4b77-9731-15cfd305b7e5 tempest-ProjectReaderTests-1840639123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7.d2b75f7f-2c70-47f8-9c3b-f36e51763d03" returned: 0 in 0.368s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:46 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-cb61f031-5f3a-4b77-9731-15cfd305b7e5 tempest-ProjectReaderTests-1840639123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7798ff01-5144-426c-944b-7774635b72b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:11:46 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e6fc30-890d-46c5-9070-98f4e8f9e217]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-cb61f031-5f3a-4b77-9731-15cfd305b7e5 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:46 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7 Sep 21 12:11:46 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:46 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-cb61f031-5f3a-4b77-9731-15cfd305b7e5 tempest-ProjectReaderTests-1840639123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7" returned: 0 in 0.387s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-cb61f031-5f3a-4b77-9731-15cfd305b7e5 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7.d2b75f7f-2c70-47f8-9c3b-f36e51763d03 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:46 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7.d2b75f7f-2c70-47f8-9c3b-f36e51763d03 Sep 21 12:11:46 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:46 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-cb61f031-5f3a-4b77-9731-15cfd305b7e5 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7.d2b75f7f-2c70-47f8-9c3b-f36e51763d03" returned: 0 in 0.380s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:46 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-cb61f031-5f3a-4b77-9731-15cfd305b7e5 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7.d2b75f7f-2c70-47f8-9c3b-f36e51763d03 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:46 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7.d2b75f7f-2c70-47f8-9c3b-f36e51763d03 Sep 21 12:11:46 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:47 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-cb61f031-5f3a-4b77-9731-15cfd305b7e5 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7.d2b75f7f-2c70-47f8-9c3b-f36e51763d03" returned: 0 in 0.253s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-cb61f031-5f3a-4b77-9731-15cfd305b7e5 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-d2b75f7f-2c70-47f8-9c3b-f36e51763d03" released by "_delete_snapshot" :: held 1.492s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-cb61f031-5f3a-4b77-9731-15cfd305b7e5 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-7798ff01-5144-426c-944b-7774635b72b7" released by "delete_snapshot" :: held 1.513s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:47 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-cb61f031-5f3a-4b77-9731-15cfd305b7e5 tempest-ProjectReaderTests-1840639123 None] Created reservations ['289025ce-cf9b-4002-80ad-fe2ac17ac43f', '2380702a-e5d6-41c9-a944-ef996cf5a758', '7bceb130-3df9-417d-8e7a-f5f63650b69a', '2c569307-9a75-4913-be96-ada5409e6854'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:47 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-cb61f031-5f3a-4b77-9731-15cfd305b7e5 tempest-ProjectReaderTests-1840639123 None] Delete snapshot completed successfully. Sep 21 12:11:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-cb61f031-5f3a-4b77-9731-15cfd305b7e5 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-d2b75f7f-2c70-47f8-9c3b-f36e51763d03-delete_snapshot" released by "delete_snapshot" :: held 1.660s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4531a9f4-9006-4897-8b5a-cca25b829dc6 tempest-ProjectReaderTests-1840639123 None] Acquiring lock "cinder-7798ff01-5144-426c-944b-7774635b72b7-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4531a9f4-9006-4897-8b5a-cca25b829dc6 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-7798ff01-5144-426c-944b-7774635b72b7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4531a9f4-9006-4897-8b5a-cca25b829dc6 tempest-ProjectReaderTests-1840639123 None] Acquiring lock "cinder-quobyte-7798ff01-5144-426c-944b-7774635b72b7" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:47 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4531a9f4-9006-4897-8b5a-cca25b829dc6 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-7798ff01-5144-426c-944b-7774635b72b7" acquired by "delete_volume" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:47 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c92f7c-5928-4e9d-8a3d-7f36fb0f123e]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:47 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4531a9f4-9006-4897-8b5a-cca25b829dc6 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:48 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7 Sep 21 12:11:48 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:48 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4531a9f4-9006-4897-8b5a-cca25b829dc6 tempest-ProjectReaderTests-1840639123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7" returned: 0 in 0.395s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4531a9f4-9006-4897-8b5a-cca25b829dc6 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:48 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7 Sep 21 12:11:48 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:48 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4531a9f4-9006-4897-8b5a-cca25b829dc6 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7798ff01-5144-426c-944b-7774635b72b7" returned: 0 in 0.274s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:48 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4531a9f4-9006-4897-8b5a-cca25b829dc6 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-7798ff01-5144-426c-944b-7774635b72b7" released by "delete_volume" :: held 0.745s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:48 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-4531a9f4-9006-4897-8b5a-cca25b829dc6 tempest-ProjectReaderTests-1840639123 None] Created reservations ['f1dad3a7-1a1f-486b-bc69-03d1dda53c77', 'a11dc767-9d53-4996-9082-ff0798c5ac21', '0458a106-58ca-436e-a6e3-afdea0dacb11', '4a697262-937a-4b7e-97c7-4fc81ff848b7'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4531a9f4-9006-4897-8b5a-cca25b829dc6 tempest-ProjectReaderTests-1840639123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4531a9f4-9006-4897-8b5a-cca25b829dc6 tempest-ProjectReaderTests-1840639123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:48 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4531a9f4-9006-4897-8b5a-cca25b829dc6 tempest-ProjectReaderTests-1840639123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:48 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-4531a9f4-9006-4897-8b5a-cca25b829dc6 tempest-ProjectReaderTests-1840639123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-4531a9f4-9006-4897-8b5a-cca25b829dc6 tempest-ProjectReaderTests-1840639123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:48 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4531a9f4-9006-4897-8b5a-cca25b829dc6 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:48 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:11:48 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:49 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-4531a9f4-9006-4897-8b5a-cca25b829dc6 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.285s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:49 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-4531a9f4-9006-4897-8b5a-cca25b829dc6 tempest-ProjectReaderTests-1840639123 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:11:49 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-4531a9f4-9006-4897-8b5a-cca25b829dc6 tempest-ProjectReaderTests-1840639123 None] Deleted volume successfully. Sep 21 12:11:49 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-4531a9f4-9006-4897-8b5a-cca25b829dc6 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-7798ff01-5144-426c-944b-7774635b72b7-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:49 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:11:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Flow 'volume_create_manager' (b82b37b2-d340-42fe-9a79-35df00703cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91569442-2578-405b-abbf-bbfff85eb529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91569442-2578-405b-abbf-bbfff85eb529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1842603249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03695ce8-3977-4eba-8b11-2b71465e297f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb8e58032794228b9717874dd335169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:49Z,use_quota=True,user_id='2c049c0e546f420296212675b08da21c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5893c87d-bcb9-44bb-a464-d1f2d98e293a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5893c87d-bcb9-44bb-a464-d1f2d98e293a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0fa7a9a-b726-4766-be0e-75f32cb55f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0fa7a9a-b726-4766-be0e-75f32cb55f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03695ce8-3977-4eba-8b11-2b71465e297f', 'volume_name': 'volume-03695ce8-3977-4eba-8b11-2b71465e297f', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (115d9827-39e3-4729-8882-96a66471023a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (115d9827-39e3-4729-8882-96a66471023a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:49 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62d223aa-2254-44b7-a35a-7d02cf93e2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:49 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Volume 03695ce8-3977-4eba-8b11-2b71465e297f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03695ce8-3977-4eba-8b11-2b71465e297f', 'volume_size': 1} Sep 21 12:11:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:49 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1842603249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03695ce8-3977-4eba-8b11-2b71465e297f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bb8e58032794228b9717874dd335169',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:49Z,use_quota=True,user_id='2c049c0e546f420296212675b08da21c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:11:49 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Creating volume 03695ce8-3977-4eba-8b11-2b71465e297f {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:11:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:49 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:49 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:49 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:11:49 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:11:49 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:49 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f 1073741824 Sep 21 12:11:49 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:50 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f 1073741824" returned: 0 in 0.471s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:50 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f Sep 21 12:11:50 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:50 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f" returned: 0 in 0.247s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:50 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:11:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62d223aa-2254-44b7-a35a-7d02cf93e2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03695ce8-3977-4eba-8b11-2b71465e297f', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21664eca-b58d-4ab5-9bdd-4f504ece055f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:50 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Volume volume-03695ce8-3977-4eba-8b11-2b71465e297f (03695ce8-3977-4eba-8b11-2b71465e297f): created successfully Sep 21 12:11:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21664eca-b58d-4ab5-9bdd-4f504ece055f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:50 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Flow 'volume_create_manager' (b82b37b2-d340-42fe-9a79-35df00703cdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:50 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-80430ec4-72e6-48af-b99d-8141ffd04f1d tempest-ProjectReaderTests-1840639123 None] Created volume successfully. Sep 21 12:11:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-ebcac909-6acc-4584-9e9b-23a4811198c3 tempest-ProjectReaderTests-1840639123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-ebcac909-6acc-4584-9e9b-23a4811198c3 tempest-ProjectReaderTests-1840639123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:50 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-ebcac909-6acc-4584-9e9b-23a4811198c3 tempest-ProjectReaderTests-1840639123 None] Creating offline snapshot fc4273b9-9a92-4334-b585-a30fab7b142b of volume 03695ce8-3977-4eba-8b11-2b71465e297f {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:11:50 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cee881-e003-4ea7-a007-9513686fc31d]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:50 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ebcac909-6acc-4584-9e9b-23a4811198c3 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:50 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f Sep 21 12:11:50 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:51 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ebcac909-6acc-4584-9e9b-23a4811198c3 tempest-ProjectReaderTests-1840639123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f" returned: 0 in 0.399s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ebcac909-6acc-4584-9e9b-23a4811198c3 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f.fc4273b9-9a92-4334-b585-a30fab7b142b 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:51 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f.fc4273b9-9a92-4334-b585-a30fab7b142b 1G Sep 21 12:11:51 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:51 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ebcac909-6acc-4584-9e9b-23a4811198c3 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f.fc4273b9-9a92-4334-b585-a30fab7b142b 1G" returned: 0 in 0.494s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ebcac909-6acc-4584-9e9b-23a4811198c3 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03695ce8-3977-4eba-8b11-2b71465e297f -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f.fc4273b9-9a92-4334-b585-a30fab7b142b {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:51 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03695ce8-3977-4eba-8b11-2b71465e297f -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f.fc4273b9-9a92-4334-b585-a30fab7b142b Sep 21 12:11:51 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:51 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:11:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Flow 'volume_create_manager' (bf6da3c5-f978-45ea-abfa-336a10097d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a58db0-834b-405e-8e27-60bf9303ee2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a58db0-834b-405e-8e27-60bf9303ee2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1954025746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec07a88-6ae8-41fd-920f-6d771f7a1155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3ab3953afc4ba588a5a6758fef10a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:52Z,use_quota=True,user_id='8da888e194c942a6896757d64cd62196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64af103-da62-4d57-85c8-7370eec6731e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64af103-da62-4d57-85c8-7370eec6731e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd823512-30d9-496c-b8ba-668536559848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd823512-30d9-496c-b8ba-668536559848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ec07a88-6ae8-41fd-920f-6d771f7a1155', 'volume_name': 'volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b78b48e-1e52-4e98-9bd4-7b839bee61e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b78b48e-1e52-4e98-9bd4-7b839bee61e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c4bfb3f-a8c8-4f77-9eb9-4e3c4bcad12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:51 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Volume 0ec07a88-6ae8-41fd-920f-6d771f7a1155: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155', 'volume_size': 1} Sep 21 12:11:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:51 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ebcac909-6acc-4584-9e9b-23a4811198c3 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03695ce8-3977-4eba-8b11-2b71465e297f -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f.fc4273b9-9a92-4334-b585-a30fab7b142b" returned: 0 in 0.303s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:51 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-ebcac909-6acc-4584-9e9b-23a4811198c3 tempest-ProjectReaderTests-1840639123 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f.fc4273b9-9a92-4334-b585-a30fab7b142b is being set with open permissions: ugo+rw Sep 21 12:11:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ebcac909-6acc-4584-9e9b-23a4811198c3 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f.fc4273b9-9a92-4334-b585-a30fab7b142b {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:51 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f.fc4273b9-9a92-4334-b585-a30fab7b142b Sep 21 12:11:51 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:52 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ebcac909-6acc-4584-9e9b-23a4811198c3 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f.fc4273b9-9a92-4334-b585-a30fab7b142b" returned: 0 in 0.266s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ebcac909-6acc-4584-9e9b-23a4811198c3 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:52 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f.info Sep 21 12:11:52 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:52 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ebcac909-6acc-4584-9e9b-23a4811198c3 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f.info" returned: 0 in 0.245s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:52 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-ebcac909-6acc-4584-9e9b-23a4811198c3 tempest-ProjectReaderTests-1840639123 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f.info is being set with open permissions: ugo+rw Sep 21 12:11:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ebcac909-6acc-4584-9e9b-23a4811198c3 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:52 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f.info Sep 21 12:11:52 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:52 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-ebcac909-6acc-4584-9e9b-23a4811198c3 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f.info" returned: 0 in 0.253s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-ebcac909-6acc-4584-9e9b-23a4811198c3 tempest-ProjectReaderTests-1840639123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.048s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.932s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1954025746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec07a88-6ae8-41fd-920f-6d771f7a1155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3ab3953afc4ba588a5a6758fef10a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:11:52Z,use_quota=True,user_id='8da888e194c942a6896757d64cd62196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:11:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Creating volume 0ec07a88-6ae8-41fd-920f-6d771f7a1155 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:11:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:52 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:11:52 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:11:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:52 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155 1073741824 Sep 21 12:11:52 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:52 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-ebcac909-6acc-4584-9e9b-23a4811198c3 tempest-ProjectReaderTests-1840639123 None] Create snapshot completed successfully Sep 21 12:11:53 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155 1073741824" returned: 0 in 0.410s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:53 devstack sudo[105899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155 Sep 21 12:11:53 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:53 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155" returned: 0 in 0.246s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:53 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:11:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:53 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c4bfb3f-a8c8-4f77-9eb9-4e3c4bcad12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:53 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6904cb95-91b0-4e9d-b3e4-ce4c2e69fb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:11:53 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Volume volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155 (0ec07a88-6ae8-41fd-920f-6d771f7a1155): created successfully Sep 21 12:11:53 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6904cb95-91b0-4e9d-b3e4-ce4c2e69fb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:11:53 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Flow 'volume_create_manager' (bf6da3c5-f978-45ea-abfa-336a10097d1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:11:53 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-d59bf744-751a-4da5-85aa-4e95462b6007 tempest-ProjectMemberTests-2128151930 None] Created volume successfully. Sep 21 12:11:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3cac20b5-bdbb-4615-95ab-763e27404fff tempest-ProjectReaderTests-1840639123 None] Acquiring lock "cinder-fc4273b9-9a92-4334-b585-a30fab7b142b-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3cac20b5-bdbb-4615-95ab-763e27404fff tempest-ProjectReaderTests-1840639123 None] Lock "cinder-fc4273b9-9a92-4334-b585-a30fab7b142b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3cac20b5-bdbb-4615-95ab-763e27404fff tempest-ProjectReaderTests-1840639123 None] Acquiring lock "cinder-quobyte-03695ce8-3977-4eba-8b11-2b71465e297f" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3cac20b5-bdbb-4615-95ab-763e27404fff tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-03695ce8-3977-4eba-8b11-2b71465e297f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3cac20b5-bdbb-4615-95ab-763e27404fff tempest-ProjectReaderTests-1840639123 None] Acquiring lock "cinder-quobyte-fc4273b9-9a92-4334-b585-a30fab7b142b" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3cac20b5-bdbb-4615-95ab-763e27404fff tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-fc4273b9-9a92-4334-b585-a30fab7b142b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:53 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-3cac20b5-bdbb-4615-95ab-763e27404fff tempest-ProjectReaderTests-1840639123 None] Deleting offline snapshot fc4273b9-9a92-4334-b585-a30fab7b142b of volume 03695ce8-3977-4eba-8b11-2b71465e297f {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:11:54 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-3cac20b5-bdbb-4615-95ab-763e27404fff tempest-ProjectReaderTests-1840639123 None] snapshot_file for this snap is: volume-03695ce8-3977-4eba-8b11-2b71465e297f.fc4273b9-9a92-4334-b585-a30fab7b142b {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:11:54 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcf17f6-51c6-46a6-b926-6ac7f0701697]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3cac20b5-bdbb-4615-95ab-763e27404fff tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f.fc4273b9-9a92-4334-b585-a30fab7b142b {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-daa505e5-d01d-4add-b150-fd11c4a483cf tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-daa505e5-d01d-4add-b150-fd11c4a483cf tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:54 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f.fc4273b9-9a92-4334-b585-a30fab7b142b Sep 21 12:11:54 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:54 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-daa505e5-d01d-4add-b150-fd11c4a483cf tempest-ProjectMemberTests-2128151930 None] Creating offline snapshot e35f43f3-b17e-4080-b694-d3de00612bd1 of volume 0ec07a88-6ae8-41fd-920f-6d771f7a1155 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:11:54 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad35f5e4-2caf-41f9-8fc4-36cd381cf4ee]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-daa505e5-d01d-4add-b150-fd11c4a483cf tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:54 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155 Sep 21 12:11:54 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:54 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3cac20b5-bdbb-4615-95ab-763e27404fff tempest-ProjectReaderTests-1840639123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f.fc4273b9-9a92-4334-b585-a30fab7b142b" returned: 0 in 0.386s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:54 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-3cac20b5-bdbb-4615-95ab-763e27404fff tempest-ProjectReaderTests-1840639123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03695ce8-3977-4eba-8b11-2b71465e297f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:11:54 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[2897d2ce-4dab-4662-8263-bb1426d41b53]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3cac20b5-bdbb-4615-95ab-763e27404fff tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:54 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f Sep 21 12:11:54 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:54 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-daa505e5-d01d-4add-b150-fd11c4a483cf tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155" returned: 0 in 0.368s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-daa505e5-d01d-4add-b150-fd11c4a483cf tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155.e35f43f3-b17e-4080-b694-d3de00612bd1 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:54 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155.e35f43f3-b17e-4080-b694-d3de00612bd1 1G Sep 21 12:11:54 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:54 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3cac20b5-bdbb-4615-95ab-763e27404fff tempest-ProjectReaderTests-1840639123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f" returned: 0 in 0.379s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3cac20b5-bdbb-4615-95ab-763e27404fff tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f.fc4273b9-9a92-4334-b585-a30fab7b142b {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:54 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f.fc4273b9-9a92-4334-b585-a30fab7b142b Sep 21 12:11:54 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:55 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-daa505e5-d01d-4add-b150-fd11c4a483cf tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155.e35f43f3-b17e-4080-b694-d3de00612bd1 1G" returned: 0 in 0.456s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-daa505e5-d01d-4add-b150-fd11c4a483cf tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155.e35f43f3-b17e-4080-b694-d3de00612bd1 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:55 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155.e35f43f3-b17e-4080-b694-d3de00612bd1 Sep 21 12:11:55 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:55 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3cac20b5-bdbb-4615-95ab-763e27404fff tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f.fc4273b9-9a92-4334-b585-a30fab7b142b" returned: 0 in 0.387s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3cac20b5-bdbb-4615-95ab-763e27404fff tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f.fc4273b9-9a92-4334-b585-a30fab7b142b {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:55 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f.fc4273b9-9a92-4334-b585-a30fab7b142b Sep 21 12:11:55 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:55 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-daa505e5-d01d-4add-b150-fd11c4a483cf tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155.e35f43f3-b17e-4080-b694-d3de00612bd1" returned: 0 in 0.317s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:55 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-daa505e5-d01d-4add-b150-fd11c4a483cf tempest-ProjectMemberTests-2128151930 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155.e35f43f3-b17e-4080-b694-d3de00612bd1 is being set with open permissions: ugo+rw Sep 21 12:11:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-daa505e5-d01d-4add-b150-fd11c4a483cf tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155.e35f43f3-b17e-4080-b694-d3de00612bd1 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:55 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155.e35f43f3-b17e-4080-b694-d3de00612bd1 Sep 21 12:11:55 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:55 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3cac20b5-bdbb-4615-95ab-763e27404fff tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f.fc4273b9-9a92-4334-b585-a30fab7b142b" returned: 0 in 0.263s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3cac20b5-bdbb-4615-95ab-763e27404fff tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-fc4273b9-9a92-4334-b585-a30fab7b142b" released by "_delete_snapshot" :: held 1.527s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3cac20b5-bdbb-4615-95ab-763e27404fff tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-03695ce8-3977-4eba-8b11-2b71465e297f" released by "delete_snapshot" :: held 1.562s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:55 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:55 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-3cac20b5-bdbb-4615-95ab-763e27404fff tempest-ProjectReaderTests-1840639123 None] Created reservations ['37e11bd8-1101-4644-9ff6-5a2274af225a', '74e78fba-d8d4-41f8-9b70-f088f8e72380', 'fc77f30e-104f-4276-a1d1-c30e1e047e07', '4c8862a1-28ce-4d9b-864a-468d15323b25'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-daa505e5-d01d-4add-b150-fd11c4a483cf tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155.e35f43f3-b17e-4080-b694-d3de00612bd1" returned: 0 in 0.257s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-daa505e5-d01d-4add-b150-fd11c4a483cf tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:55 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155.info Sep 21 12:11:55 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:55 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-3cac20b5-bdbb-4615-95ab-763e27404fff tempest-ProjectReaderTests-1840639123 None] Delete snapshot completed successfully. Sep 21 12:11:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3cac20b5-bdbb-4615-95ab-763e27404fff tempest-ProjectReaderTests-1840639123 None] Lock "cinder-fc4273b9-9a92-4334-b585-a30fab7b142b-delete_snapshot" released by "delete_snapshot" :: held 1.740s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:55 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-daa505e5-d01d-4add-b150-fd11c4a483cf tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155.info" returned: 0 in 0.278s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:55 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-daa505e5-d01d-4add-b150-fd11c4a483cf tempest-ProjectMemberTests-2128151930 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155.info is being set with open permissions: ugo+rw Sep 21 12:11:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-daa505e5-d01d-4add-b150-fd11c4a483cf tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:55 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155.info Sep 21 12:11:55 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3e988401-1200-4ded-9a48-dbe0224865e5 tempest-ProjectReaderTests-1840639123 None] Acquiring lock "cinder-03695ce8-3977-4eba-8b11-2b71465e297f-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3e988401-1200-4ded-9a48-dbe0224865e5 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-03695ce8-3977-4eba-8b11-2b71465e297f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3e988401-1200-4ded-9a48-dbe0224865e5 tempest-ProjectReaderTests-1840639123 None] Acquiring lock "cinder-quobyte-03695ce8-3977-4eba-8b11-2b71465e297f" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3e988401-1200-4ded-9a48-dbe0224865e5 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-03695ce8-3977-4eba-8b11-2b71465e297f" acquired by "delete_volume" :: waited 0.014s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:56 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-daa505e5-d01d-4add-b150-fd11c4a483cf tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155.info" returned: 0 in 0.311s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-daa505e5-d01d-4add-b150-fd11c4a483cf tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.091s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:56 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58b0683-46b8-4e14-9e49-0a6a1064630c]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3e988401-1200-4ded-9a48-dbe0224865e5 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:56 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-daa505e5-d01d-4add-b150-fd11c4a483cf tempest-ProjectMemberTests-2128151930 None] Create snapshot completed successfully Sep 21 12:11:56 devstack sudo[105944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f Sep 21 12:11:56 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:56 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3e988401-1200-4ded-9a48-dbe0224865e5 tempest-ProjectReaderTests-1840639123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f" returned: 0 in 0.383s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3e988401-1200-4ded-9a48-dbe0224865e5 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:56 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f Sep 21 12:11:56 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:56 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3e988401-1200-4ded-9a48-dbe0224865e5 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-03695ce8-3977-4eba-8b11-2b71465e297f" returned: 0 in 0.250s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3e988401-1200-4ded-9a48-dbe0224865e5 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-quobyte-03695ce8-3977-4eba-8b11-2b71465e297f" released by "delete_volume" :: held 0.738s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:56 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-3e988401-1200-4ded-9a48-dbe0224865e5 tempest-ProjectReaderTests-1840639123 None] Created reservations ['a931ba95-5b47-4d5a-bd4e-74a4f8c06435', '579f0dc6-d02d-4439-906b-c56f86e9920d', '97b7dcb4-2cc2-4e98-8007-513e1d70fb4b', 'd98833ee-5cf4-49c7-8c11-50e7a1cbe508'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3e988401-1200-4ded-9a48-dbe0224865e5 tempest-ProjectReaderTests-1840639123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:11:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3e988401-1200-4ded-9a48-dbe0224865e5 tempest-ProjectReaderTests-1840639123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:11:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3e988401-1200-4ded-9a48-dbe0224865e5 tempest-ProjectReaderTests-1840639123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:11:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3e988401-1200-4ded-9a48-dbe0224865e5 tempest-ProjectReaderTests-1840639123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:11:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3e988401-1200-4ded-9a48-dbe0224865e5 tempest-ProjectReaderTests-1840639123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:11:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3e988401-1200-4ded-9a48-dbe0224865e5 tempest-ProjectReaderTests-1840639123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:57 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:11:57 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:57 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3e988401-1200-4ded-9a48-dbe0224865e5 tempest-ProjectReaderTests-1840639123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.249s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:57 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-3e988401-1200-4ded-9a48-dbe0224865e5 tempest-ProjectReaderTests-1840639123 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:11:57 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-3e988401-1200-4ded-9a48-dbe0224865e5 tempest-ProjectReaderTests-1840639123 None] Deleted volume successfully. Sep 21 12:11:57 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3e988401-1200-4ded-9a48-dbe0224865e5 tempest-ProjectReaderTests-1840639123 None] Lock "cinder-03695ce8-3977-4eba-8b11-2b71465e297f-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:57 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fba9ab53-31ca-4a4b-8b3f-25b1cacbda46 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-e35f43f3-b17e-4080-b694-d3de00612bd1-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:57 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fba9ab53-31ca-4a4b-8b3f-25b1cacbda46 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-e35f43f3-b17e-4080-b694-d3de00612bd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:57 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fba9ab53-31ca-4a4b-8b3f-25b1cacbda46 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-quobyte-0ec07a88-6ae8-41fd-920f-6d771f7a1155" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:57 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fba9ab53-31ca-4a4b-8b3f-25b1cacbda46 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-0ec07a88-6ae8-41fd-920f-6d771f7a1155" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:57 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fba9ab53-31ca-4a4b-8b3f-25b1cacbda46 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-quobyte-e35f43f3-b17e-4080-b694-d3de00612bd1" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:57 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fba9ab53-31ca-4a4b-8b3f-25b1cacbda46 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-e35f43f3-b17e-4080-b694-d3de00612bd1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-fba9ab53-31ca-4a4b-8b3f-25b1cacbda46 tempest-ProjectMemberTests-2128151930 None] Deleting offline snapshot e35f43f3-b17e-4080-b694-d3de00612bd1 of volume 0ec07a88-6ae8-41fd-920f-6d771f7a1155 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:11:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-fba9ab53-31ca-4a4b-8b3f-25b1cacbda46 tempest-ProjectMemberTests-2128151930 None] snapshot_file for this snap is: volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155.e35f43f3-b17e-4080-b694-d3de00612bd1 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:11:57 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0c542f-eddb-4bd8-9edd-d5523e8850ce]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fba9ab53-31ca-4a4b-8b3f-25b1cacbda46 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155.e35f43f3-b17e-4080-b694-d3de00612bd1 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:57 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155.e35f43f3-b17e-4080-b694-d3de00612bd1 Sep 21 12:11:57 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:57 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fba9ab53-31ca-4a4b-8b3f-25b1cacbda46 tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155.e35f43f3-b17e-4080-b694-d3de00612bd1" returned: 0 in 0.429s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-fba9ab53-31ca-4a4b-8b3f-25b1cacbda46 tempest-ProjectMemberTests-2128151930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:11:57 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3456c41-7529-4de3-8e15-bf63eb3800b4]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fba9ab53-31ca-4a4b-8b3f-25b1cacbda46 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:58 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155 Sep 21 12:11:58 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:58 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fba9ab53-31ca-4a4b-8b3f-25b1cacbda46 tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155" returned: 0 in 0.390s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fba9ab53-31ca-4a4b-8b3f-25b1cacbda46 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155.e35f43f3-b17e-4080-b694-d3de00612bd1 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:58 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155.e35f43f3-b17e-4080-b694-d3de00612bd1 Sep 21 12:11:58 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:58 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fba9ab53-31ca-4a4b-8b3f-25b1cacbda46 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155.e35f43f3-b17e-4080-b694-d3de00612bd1" returned: 0 in 0.389s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fba9ab53-31ca-4a4b-8b3f-25b1cacbda46 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155.e35f43f3-b17e-4080-b694-d3de00612bd1 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:58 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155.e35f43f3-b17e-4080-b694-d3de00612bd1 Sep 21 12:11:58 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:11:58 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Sep 21 12:11:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-fba9ab53-31ca-4a4b-8b3f-25b1cacbda46 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155.e35f43f3-b17e-4080-b694-d3de00612bd1" returned: 0 in 0.277s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:11:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fba9ab53-31ca-4a4b-8b3f-25b1cacbda46 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-e35f43f3-b17e-4080-b694-d3de00612bd1" released by "_delete_snapshot" :: held 1.622s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fba9ab53-31ca-4a4b-8b3f-25b1cacbda46 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-0ec07a88-6ae8-41fd-920f-6d771f7a1155" released by "delete_snapshot" :: held 1.648s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:59 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-fba9ab53-31ca-4a4b-8b3f-25b1cacbda46 tempest-ProjectMemberTests-2128151930 None] Created reservations ['ec346dde-0f11-4cc6-b72b-e2a36af4b0ed', '429315d8-8333-4f48-b564-aaa53c38cc88', '474cd597-9673-4440-8aec-7cde6c2cabf2', '2f41d380-fa56-4ad7-bb80-81d7f6684978'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:11:59 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-fba9ab53-31ca-4a4b-8b3f-25b1cacbda46 tempest-ProjectMemberTests-2128151930 None] Delete snapshot completed successfully. Sep 21 12:11:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-fba9ab53-31ca-4a4b-8b3f-25b1cacbda46 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-e35f43f3-b17e-4080-b694-d3de00612bd1-delete_snapshot" released by "delete_snapshot" :: held 1.811s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:11:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6cf42b0a-e600-4fdc-a1b8-d4efff7058aa tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-0ec07a88-6ae8-41fd-920f-6d771f7a1155-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6cf42b0a-e600-4fdc-a1b8-d4efff7058aa tempest-ProjectMemberTests-2128151930 None] Lock "cinder-0ec07a88-6ae8-41fd-920f-6d771f7a1155-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6cf42b0a-e600-4fdc-a1b8-d4efff7058aa tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-quobyte-0ec07a88-6ae8-41fd-920f-6d771f7a1155" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:11:59 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6cf42b0a-e600-4fdc-a1b8-d4efff7058aa tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-0ec07a88-6ae8-41fd-920f-6d771f7a1155" acquired by "delete_volume" :: waited 0.021s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:11:59 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f17c78c-aa79-4be2-a46c-a5e1927bb630]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:11:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6cf42b0a-e600-4fdc-a1b8-d4efff7058aa tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:11:59 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155 Sep 21 12:11:59 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:00 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6cf42b0a-e600-4fdc-a1b8-d4efff7058aa tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155" returned: 0 in 0.395s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6cf42b0a-e600-4fdc-a1b8-d4efff7058aa tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:00 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155 Sep 21 12:12:00 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:00 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6cf42b0a-e600-4fdc-a1b8-d4efff7058aa tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-0ec07a88-6ae8-41fd-920f-6d771f7a1155" returned: 0 in 0.271s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:00 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6cf42b0a-e600-4fdc-a1b8-d4efff7058aa tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-0ec07a88-6ae8-41fd-920f-6d771f7a1155" released by "delete_volume" :: held 0.738s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:00 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-6cf42b0a-e600-4fdc-a1b8-d4efff7058aa tempest-ProjectMemberTests-2128151930 None] Created reservations ['f5e603bb-d65f-4690-a7af-f8325f3ded00', '923590d0-5f56-4628-8691-ee580483bcde', 'eace8377-5cca-4db4-9c23-e737e2766ec8', '359c1db8-5233-4d25-bd2e-bb5fbf8aeab5'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:12:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6cf42b0a-e600-4fdc-a1b8-d4efff7058aa tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6cf42b0a-e600-4fdc-a1b8-d4efff7058aa tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6cf42b0a-e600-4fdc-a1b8-d4efff7058aa tempest-ProjectMemberTests-2128151930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:12:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-6cf42b0a-e600-4fdc-a1b8-d4efff7058aa tempest-ProjectMemberTests-2128151930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:12:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-6cf42b0a-e600-4fdc-a1b8-d4efff7058aa tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6cf42b0a-e600-4fdc-a1b8-d4efff7058aa tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:00 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:12:00 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:00 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-6cf42b0a-e600-4fdc-a1b8-d4efff7058aa tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.274s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:00 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-6cf42b0a-e600-4fdc-a1b8-d4efff7058aa tempest-ProjectMemberTests-2128151930 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:12:00 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-6cf42b0a-e600-4fdc-a1b8-d4efff7058aa tempest-ProjectMemberTests-2128151930 None] Deleted volume successfully. Sep 21 12:12:00 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-6cf42b0a-e600-4fdc-a1b8-d4efff7058aa tempest-ProjectMemberTests-2128151930 None] Lock "cinder-0ec07a88-6ae8-41fd-920f-6d771f7a1155-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:01 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:12:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Flow 'volume_create_manager' (1afcb276-f419-419a-99f1-56815e6f6fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:12:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a82b75af-235c-4864-bd1c-344f10910c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a82b75af-235c-4864-bd1c-344f10910c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-886490152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9699444d-5381-437a-b801-0c3e15143ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3ab3953afc4ba588a5a6758fef10a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:12:01Z,use_quota=True,user_id='8da888e194c942a6896757d64cd62196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d35f6f-9e9f-48e0-9bf5-3177683fe873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d35f6f-9e9f-48e0-9bf5-3177683fe873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a59839-e9b4-47bb-a5be-d7f530238ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a59839-e9b4-47bb-a5be-d7f530238ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9699444d-5381-437a-b801-0c3e15143ec8', 'volume_name': 'volume-9699444d-5381-437a-b801-0c3e15143ec8', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9127912b-2329-41a0-a72f-ff8bebe0477a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9127912b-2329-41a0-a72f-ff8bebe0477a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:01 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa82c74-5eba-4e0a-8e87-5134902cab88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:01 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Volume 9699444d-5381-437a-b801-0c3e15143ec8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9699444d-5381-437a-b801-0c3e15143ec8', 'volume_size': 1} Sep 21 12:12:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-886490152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9699444d-5381-437a-b801-0c3e15143ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3ab3953afc4ba588a5a6758fef10a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:12:01Z,use_quota=True,user_id='8da888e194c942a6896757d64cd62196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:12:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Creating volume 9699444d-5381-437a-b801-0c3e15143ec8 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:12:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:12:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:12:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:01 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:12:01 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:12:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:01 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8 1073741824 Sep 21 12:12:01 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:01 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8 1073741824" returned: 0 in 0.445s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:01 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8 Sep 21 12:12:01 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:02 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8" returned: 0 in 0.272s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:12:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa82c74-5eba-4e0a-8e87-5134902cab88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9699444d-5381-437a-b801-0c3e15143ec8', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f1c48ff-c093-42c9-9061-a979a889ccde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:02 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Volume volume-9699444d-5381-437a-b801-0c3e15143ec8 (9699444d-5381-437a-b801-0c3e15143ec8): created successfully Sep 21 12:12:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f1c48ff-c093-42c9-9061-a979a889ccde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:02 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Flow 'volume_create_manager' (1afcb276-f419-419a-99f1-56815e6f6fcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:12:02 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-87ab9670-d456-4056-af69-d8557ac6c2c8 tempest-ProjectMemberTests-2128151930 None] Created volume successfully. Sep 21 12:12:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-862f586a-e85e-43c6-9e53-cc7dc5068ac4 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-862f586a-e85e-43c6-9e53-cc7dc5068ac4 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:02 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-862f586a-e85e-43c6-9e53-cc7dc5068ac4 tempest-ProjectMemberTests-2128151930 None] Creating offline snapshot 1777a8aa-b476-41d1-9431-5cc414f3aa8a of volume 9699444d-5381-437a-b801-0c3e15143ec8 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:12:02 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4d78c6-af9f-44ee-8bd6-de615370e95f]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-862f586a-e85e-43c6-9e53-cc7dc5068ac4 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:02 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8 Sep 21 12:12:02 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:02 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-862f586a-e85e-43c6-9e53-cc7dc5068ac4 tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8" returned: 0 in 0.387s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-862f586a-e85e-43c6-9e53-cc7dc5068ac4 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8.1777a8aa-b476-41d1-9431-5cc414f3aa8a 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:02 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8.1777a8aa-b476-41d1-9431-5cc414f3aa8a 1G Sep 21 12:12:02 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:03 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-862f586a-e85e-43c6-9e53-cc7dc5068ac4 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8.1777a8aa-b476-41d1-9431-5cc414f3aa8a 1G" returned: 0 in 0.387s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-862f586a-e85e-43c6-9e53-cc7dc5068ac4 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9699444d-5381-437a-b801-0c3e15143ec8 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8.1777a8aa-b476-41d1-9431-5cc414f3aa8a {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:03 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9699444d-5381-437a-b801-0c3e15143ec8 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8.1777a8aa-b476-41d1-9431-5cc414f3aa8a Sep 21 12:12:03 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:03 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-862f586a-e85e-43c6-9e53-cc7dc5068ac4 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9699444d-5381-437a-b801-0c3e15143ec8 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8.1777a8aa-b476-41d1-9431-5cc414f3aa8a" returned: 0 in 0.284s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:03 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-862f586a-e85e-43c6-9e53-cc7dc5068ac4 tempest-ProjectMemberTests-2128151930 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8.1777a8aa-b476-41d1-9431-5cc414f3aa8a is being set with open permissions: ugo+rw Sep 21 12:12:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-862f586a-e85e-43c6-9e53-cc7dc5068ac4 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8.1777a8aa-b476-41d1-9431-5cc414f3aa8a {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:03 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8.1777a8aa-b476-41d1-9431-5cc414f3aa8a Sep 21 12:12:03 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:03 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 12:12:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:12:03 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:12:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-862f586a-e85e-43c6-9e53-cc7dc5068ac4 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8.1777a8aa-b476-41d1-9431-5cc414f3aa8a" returned: 0 in 0.251s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:03 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:12:03 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-862f586a-e85e-43c6-9e53-cc7dc5068ac4 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:03 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8.info Sep 21 12:12:03 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:04 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.300s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:04 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:12:04 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 12:12:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread count: 28 {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 12:12:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread info: [<_MainThread(MainThread, started 132841976594560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 12:12:04 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-862f586a-e85e-43c6-9e53-cc7dc5068ac4 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8.info" returned: 0 in 0.305s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:04 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-862f586a-e85e-43c6-9e53-cc7dc5068ac4 tempest-ProjectMemberTests-2128151930 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8.info is being set with open permissions: ugo+rw Sep 21 12:12:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-862f586a-e85e-43c6-9e53-cc7dc5068ac4 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:04 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8.info Sep 21 12:12:04 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:04 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-862f586a-e85e-43c6-9e53-cc7dc5068ac4 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8.info" returned: 0 in 0.301s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-862f586a-e85e-43c6-9e53-cc7dc5068ac4 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.029s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:04 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-862f586a-e85e-43c6-9e53-cc7dc5068ac4 tempest-ProjectMemberTests-2128151930 None] Create snapshot completed successfully Sep 21 12:12:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-d494bc10-639e-4d74-9514-d978398f5d16 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-1777a8aa-b476-41d1-9431-5cc414f3aa8a-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-d494bc10-639e-4d74-9514-d978398f5d16 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-1777a8aa-b476-41d1-9431-5cc414f3aa8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-d494bc10-639e-4d74-9514-d978398f5d16 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-quobyte-9699444d-5381-437a-b801-0c3e15143ec8" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-d494bc10-639e-4d74-9514-d978398f5d16 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-9699444d-5381-437a-b801-0c3e15143ec8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-d494bc10-639e-4d74-9514-d978398f5d16 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-quobyte-1777a8aa-b476-41d1-9431-5cc414f3aa8a" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-d494bc10-639e-4d74-9514-d978398f5d16 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-1777a8aa-b476-41d1-9431-5cc414f3aa8a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:05 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-d494bc10-639e-4d74-9514-d978398f5d16 tempest-ProjectMemberTests-2128151930 None] Deleting offline snapshot 1777a8aa-b476-41d1-9431-5cc414f3aa8a of volume 9699444d-5381-437a-b801-0c3e15143ec8 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:12:05 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-d494bc10-639e-4d74-9514-d978398f5d16 tempest-ProjectMemberTests-2128151930 None] snapshot_file for this snap is: volume-9699444d-5381-437a-b801-0c3e15143ec8.1777a8aa-b476-41d1-9431-5cc414f3aa8a {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:12:05 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f77e95c-147f-4517-8d8b-aa2842d99621]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d494bc10-639e-4d74-9514-d978398f5d16 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8.1777a8aa-b476-41d1-9431-5cc414f3aa8a {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:05 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8.1777a8aa-b476-41d1-9431-5cc414f3aa8a Sep 21 12:12:05 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:05 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d494bc10-639e-4d74-9514-d978398f5d16 tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8.1777a8aa-b476-41d1-9431-5cc414f3aa8a" returned: 0 in 0.378s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:05 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-d494bc10-639e-4d74-9514-d978398f5d16 tempest-ProjectMemberTests-2128151930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9699444d-5381-437a-b801-0c3e15143ec8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:12:06 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cd3c9d-77ed-43f9-848e-695b594720b5]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d494bc10-639e-4d74-9514-d978398f5d16 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:06 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8 Sep 21 12:12:06 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:06 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d494bc10-639e-4d74-9514-d978398f5d16 tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8" returned: 0 in 0.376s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d494bc10-639e-4d74-9514-d978398f5d16 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8.1777a8aa-b476-41d1-9431-5cc414f3aa8a {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:06 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8.1777a8aa-b476-41d1-9431-5cc414f3aa8a Sep 21 12:12:06 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:06 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d494bc10-639e-4d74-9514-d978398f5d16 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8.1777a8aa-b476-41d1-9431-5cc414f3aa8a" returned: 0 in 0.384s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d494bc10-639e-4d74-9514-d978398f5d16 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8.1777a8aa-b476-41d1-9431-5cc414f3aa8a {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:06 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8.1777a8aa-b476-41d1-9431-5cc414f3aa8a Sep 21 12:12:06 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:07 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d494bc10-639e-4d74-9514-d978398f5d16 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8.1777a8aa-b476-41d1-9431-5cc414f3aa8a" returned: 0 in 0.257s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:07 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-d494bc10-639e-4d74-9514-d978398f5d16 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-1777a8aa-b476-41d1-9431-5cc414f3aa8a" released by "_delete_snapshot" :: held 1.520s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:07 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-d494bc10-639e-4d74-9514-d978398f5d16 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-9699444d-5381-437a-b801-0c3e15143ec8" released by "delete_snapshot" :: held 1.542s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:07 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-d494bc10-639e-4d74-9514-d978398f5d16 tempest-ProjectMemberTests-2128151930 None] Created reservations ['8f8f6d65-2f03-41ac-a617-18c7e52ea34a', 'e7c6ebb0-7cba-435d-ae20-048d49af2651', '699fa3ed-d886-437c-9abb-95e3444fa53b', '5f8128d1-8e04-4167-9091-687e03ade411'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:12:07 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-d494bc10-639e-4d74-9514-d978398f5d16 tempest-ProjectMemberTests-2128151930 None] Delete snapshot completed successfully. Sep 21 12:12:07 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-d494bc10-639e-4d74-9514-d978398f5d16 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-1777a8aa-b476-41d1-9431-5cc414f3aa8a-delete_snapshot" released by "delete_snapshot" :: held 1.707s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:07 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-11d07926-5ac2-472a-8a5c-d7d3d603396c tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-9699444d-5381-437a-b801-0c3e15143ec8-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:07 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-11d07926-5ac2-472a-8a5c-d7d3d603396c tempest-ProjectMemberTests-2128151930 None] Lock "cinder-9699444d-5381-437a-b801-0c3e15143ec8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:07 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-11d07926-5ac2-472a-8a5c-d7d3d603396c tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-quobyte-9699444d-5381-437a-b801-0c3e15143ec8" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:07 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-11d07926-5ac2-472a-8a5c-d7d3d603396c tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-9699444d-5381-437a-b801-0c3e15143ec8" acquired by "delete_volume" :: waited 0.015s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:07 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d14761f-4c0a-47d6-9bc1-dcda0a6f0ceb]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-11d07926-5ac2-472a-8a5c-d7d3d603396c tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:07 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8 Sep 21 12:12:07 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:08 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-11d07926-5ac2-472a-8a5c-d7d3d603396c tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8" returned: 0 in 0.387s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-11d07926-5ac2-472a-8a5c-d7d3d603396c tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:08 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8 Sep 21 12:12:08 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:08 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-11d07926-5ac2-472a-8a5c-d7d3d603396c tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-9699444d-5381-437a-b801-0c3e15143ec8" returned: 0 in 0.286s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:08 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-11d07926-5ac2-472a-8a5c-d7d3d603396c tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-9699444d-5381-437a-b801-0c3e15143ec8" released by "delete_volume" :: held 0.747s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:08 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-11d07926-5ac2-472a-8a5c-d7d3d603396c tempest-ProjectMemberTests-2128151930 None] Created reservations ['fa91d6fe-1fb7-4c39-a640-021e6e4f79b3', 'b03d8250-f9c7-4093-829a-60ea5f7f84c7', 'b80524a4-a888-4ca3-bc57-fb5d7dd670f6', 'f13049a8-55fb-4e54-8f7a-ce4556c40906'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:12:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-11d07926-5ac2-472a-8a5c-d7d3d603396c tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-11d07926-5ac2-472a-8a5c-d7d3d603396c tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:08 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-11d07926-5ac2-472a-8a5c-d7d3d603396c tempest-ProjectMemberTests-2128151930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:12:08 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-11d07926-5ac2-472a-8a5c-d7d3d603396c tempest-ProjectMemberTests-2128151930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:12:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-11d07926-5ac2-472a-8a5c-d7d3d603396c tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-11d07926-5ac2-472a-8a5c-d7d3d603396c tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:08 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:12:08 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:08 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-11d07926-5ac2-472a-8a5c-d7d3d603396c tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.276s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:08 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-11d07926-5ac2-472a-8a5c-d7d3d603396c tempest-ProjectMemberTests-2128151930 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:12:08 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-11d07926-5ac2-472a-8a5c-d7d3d603396c tempest-ProjectMemberTests-2128151930 None] Deleted volume successfully. Sep 21 12:12:09 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-11d07926-5ac2-472a-8a5c-d7d3d603396c tempest-ProjectMemberTests-2128151930 None] Lock "cinder-9699444d-5381-437a-b801-0c3e15143ec8-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:09 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:12:09 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Flow 'volume_create_manager' (0625fcaf-0557-413f-ae23-d41287f6010a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:12:09 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (791eb4d3-fef5-4b7c-af97-7fac79125887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:09 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (791eb4d3-fef5-4b7c-af97-7fac79125887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-861732969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3ab3953afc4ba588a5a6758fef10a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:12:09Z,use_quota=True,user_id='8da888e194c942a6896757d64cd62196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:09 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d89a32-b848-4c63-9f68-8f53b62b7657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:09 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d89a32-b848-4c63-9f68-8f53b62b7657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:09 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e5d4fd-9475-49a3-9857-68d807542592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:09 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e5d4fd-9475-49a3-9857-68d807542592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae', 'volume_name': 'volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:09 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0739384-5f65-4a65-adf3-1b92ed7907b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:09 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0739384-5f65-4a65-adf3-1b92ed7907b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:09 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7442bf50-fcdc-47dd-a2e8-d2f288983587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:09 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Volume 8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae', 'volume_size': 1} Sep 21 12:12:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-861732969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3ab3953afc4ba588a5a6758fef10a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:12:09Z,use_quota=True,user_id='8da888e194c942a6896757d64cd62196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:12:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Creating volume 8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:12:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:12:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:12:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:12:09 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:12:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:09 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae 1073741824 Sep 21 12:12:09 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:09 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae 1073741824" returned: 0 in 0.487s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:10 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae Sep 21 12:12:10 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:10 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae" returned: 0 in 0.286s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:10 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:12:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:10 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7442bf50-fcdc-47dd-a2e8-d2f288983587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:10 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4bf601-2c1f-493f-9089-58b148a4d8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:10 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Volume volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae (8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae): created successfully Sep 21 12:12:10 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4bf601-2c1f-493f-9089-58b148a4d8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:10 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Flow 'volume_create_manager' (0625fcaf-0557-413f-ae23-d41287f6010a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:12:10 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-d3fa3d59-44dd-47d9-99c6-41d967bcb07a tempest-ProjectMemberTests-2128151930 None] Created volume successfully. Sep 21 12:12:11 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:DELETE=20,cinder:UPDATE=226,cinder:SELECT=179,cinder:INSERT=62 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:12:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-272c9a69-0427-4607-a033-f7cc4bc02b51 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-272c9a69-0427-4607-a033-f7cc4bc02b51 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:11 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-272c9a69-0427-4607-a033-f7cc4bc02b51 tempest-ProjectMemberTests-2128151930 None] Creating offline snapshot 4fd4096d-df7b-4e93-9fe7-30cb719e1194 of volume 8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:12:11 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e3ebc0-5d00-4964-b20e-ad697f612fb9]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-272c9a69-0427-4607-a033-f7cc4bc02b51 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:11 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae Sep 21 12:12:11 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:12 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-272c9a69-0427-4607-a033-f7cc4bc02b51 tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae" returned: 0 in 0.390s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-272c9a69-0427-4607-a033-f7cc4bc02b51 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae.4fd4096d-df7b-4e93-9fe7-30cb719e1194 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:12 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae.4fd4096d-df7b-4e93-9fe7-30cb719e1194 1G Sep 21 12:12:12 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:12 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-272c9a69-0427-4607-a033-f7cc4bc02b51 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae.4fd4096d-df7b-4e93-9fe7-30cb719e1194 1G" returned: 0 in 0.456s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-272c9a69-0427-4607-a033-f7cc4bc02b51 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae.4fd4096d-df7b-4e93-9fe7-30cb719e1194 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:12 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae.4fd4096d-df7b-4e93-9fe7-30cb719e1194 Sep 21 12:12:12 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:12 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-272c9a69-0427-4607-a033-f7cc4bc02b51 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae.4fd4096d-df7b-4e93-9fe7-30cb719e1194" returned: 0 in 0.320s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:12 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-272c9a69-0427-4607-a033-f7cc4bc02b51 tempest-ProjectMemberTests-2128151930 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae.4fd4096d-df7b-4e93-9fe7-30cb719e1194 is being set with open permissions: ugo+rw Sep 21 12:12:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-272c9a69-0427-4607-a033-f7cc4bc02b51 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae.4fd4096d-df7b-4e93-9fe7-30cb719e1194 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:12 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae.4fd4096d-df7b-4e93-9fe7-30cb719e1194 Sep 21 12:12:12 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:13 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-272c9a69-0427-4607-a033-f7cc4bc02b51 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae.4fd4096d-df7b-4e93-9fe7-30cb719e1194" returned: 0 in 0.249s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:13 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=174,cinder:INSERT=66,cinder:UPDATE=237,cinder:DELETE=20 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:12:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-272c9a69-0427-4607-a033-f7cc4bc02b51 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:13 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae.info Sep 21 12:12:13 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:13 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-272c9a69-0427-4607-a033-f7cc4bc02b51 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae.info" returned: 0 in 0.270s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:13 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-272c9a69-0427-4607-a033-f7cc4bc02b51 tempest-ProjectMemberTests-2128151930 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae.info is being set with open permissions: ugo+rw Sep 21 12:12:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-272c9a69-0427-4607-a033-f7cc4bc02b51 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:13 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae.info Sep 21 12:12:13 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:13 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-272c9a69-0427-4607-a033-f7cc4bc02b51 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae.info" returned: 0 in 0.266s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-272c9a69-0427-4607-a033-f7cc4bc02b51 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.056s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:13 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-272c9a69-0427-4607-a033-f7cc4bc02b51 tempest-ProjectMemberTests-2128151930 None] Create snapshot completed successfully Sep 21 12:12:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1552e19e-fdcd-4a64-b798-e89fbd99d5b0 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-4fd4096d-df7b-4e93-9fe7-30cb719e1194-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1552e19e-fdcd-4a64-b798-e89fbd99d5b0 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-4fd4096d-df7b-4e93-9fe7-30cb719e1194-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1552e19e-fdcd-4a64-b798-e89fbd99d5b0 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-quobyte-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1552e19e-fdcd-4a64-b798-e89fbd99d5b0 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1552e19e-fdcd-4a64-b798-e89fbd99d5b0 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-quobyte-4fd4096d-df7b-4e93-9fe7-30cb719e1194" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1552e19e-fdcd-4a64-b798-e89fbd99d5b0 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-4fd4096d-df7b-4e93-9fe7-30cb719e1194" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:14 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1552e19e-fdcd-4a64-b798-e89fbd99d5b0 tempest-ProjectMemberTests-2128151930 None] Deleting offline snapshot 4fd4096d-df7b-4e93-9fe7-30cb719e1194 of volume 8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:12:14 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1552e19e-fdcd-4a64-b798-e89fbd99d5b0 tempest-ProjectMemberTests-2128151930 None] snapshot_file for this snap is: volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae.4fd4096d-df7b-4e93-9fe7-30cb719e1194 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:12:14 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7359006-6181-49da-9ed1-42eb1109ef84]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1552e19e-fdcd-4a64-b798-e89fbd99d5b0 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae.4fd4096d-df7b-4e93-9fe7-30cb719e1194 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:15 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae.4fd4096d-df7b-4e93-9fe7-30cb719e1194 Sep 21 12:12:15 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:15 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1552e19e-fdcd-4a64-b798-e89fbd99d5b0 tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae.4fd4096d-df7b-4e93-9fe7-30cb719e1194" returned: 0 in 0.391s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:15 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1552e19e-fdcd-4a64-b798-e89fbd99d5b0 tempest-ProjectMemberTests-2128151930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:12:15 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7c8169-a583-4596-87c2-63ec6f757fb3]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1552e19e-fdcd-4a64-b798-e89fbd99d5b0 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:15 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae Sep 21 12:12:15 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:15 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1552e19e-fdcd-4a64-b798-e89fbd99d5b0 tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae" returned: 0 in 0.474s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1552e19e-fdcd-4a64-b798-e89fbd99d5b0 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae.4fd4096d-df7b-4e93-9fe7-30cb719e1194 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:15 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae.4fd4096d-df7b-4e93-9fe7-30cb719e1194 Sep 21 12:12:15 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:16 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1552e19e-fdcd-4a64-b798-e89fbd99d5b0 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae.4fd4096d-df7b-4e93-9fe7-30cb719e1194" returned: 0 in 0.412s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1552e19e-fdcd-4a64-b798-e89fbd99d5b0 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae.4fd4096d-df7b-4e93-9fe7-30cb719e1194 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:16 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae.4fd4096d-df7b-4e93-9fe7-30cb719e1194 Sep 21 12:12:16 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:16 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:16 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1552e19e-fdcd-4a64-b798-e89fbd99d5b0 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae.4fd4096d-df7b-4e93-9fe7-30cb719e1194" returned: 0 in 0.247s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:16 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1552e19e-fdcd-4a64-b798-e89fbd99d5b0 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-4fd4096d-df7b-4e93-9fe7-30cb719e1194" released by "_delete_snapshot" :: held 1.647s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:16 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1552e19e-fdcd-4a64-b798-e89fbd99d5b0 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae" released by "delete_snapshot" :: held 1.675s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:16 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-1552e19e-fdcd-4a64-b798-e89fbd99d5b0 tempest-ProjectMemberTests-2128151930 None] Created reservations ['e3e88616-18ee-4178-bc41-a0b0945e93af', 'ac41cd63-e2df-44d2-8389-7783906b759e', 'a370a9d8-73ac-427f-aed9-7873bca4c85c', 'd6a0380f-663a-4fc5-8ff9-3e687415a021'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:12:16 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1552e19e-fdcd-4a64-b798-e89fbd99d5b0 tempest-ProjectMemberTests-2128151930 None] Delete snapshot completed successfully. Sep 21 12:12:16 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1552e19e-fdcd-4a64-b798-e89fbd99d5b0 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-4fd4096d-df7b-4e93-9fe7-30cb719e1194-delete_snapshot" released by "delete_snapshot" :: held 1.856s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-16da472d-f208-4047-b43a-259aa02c9bd6 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-16da472d-f208-4047-b43a-259aa02c9bd6 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-16da472d-f208-4047-b43a-259aa02c9bd6 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-quobyte-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-16da472d-f208-4047-b43a-259aa02c9bd6 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae" acquired by "delete_volume" :: waited 0.017s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:17 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[359cf529-cba2-4967-a694-da8637ea7bd6]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-16da472d-f208-4047-b43a-259aa02c9bd6 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:17 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae Sep 21 12:12:17 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:17 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-16da472d-f208-4047-b43a-259aa02c9bd6 tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae" returned: 0 in 0.419s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-16da472d-f208-4047-b43a-259aa02c9bd6 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:17 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae Sep 21 12:12:17 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:17 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:17 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-16da472d-f208-4047-b43a-259aa02c9bd6 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae" returned: 0 in 0.287s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:17 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-16da472d-f208-4047-b43a-259aa02c9bd6 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae" released by "delete_volume" :: held 0.786s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:17 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-16da472d-f208-4047-b43a-259aa02c9bd6 tempest-ProjectMemberTests-2128151930 None] Created reservations ['8cbe204e-947f-46eb-ae07-1d2f9067488c', '18d3bff8-03d8-4293-b42d-c5ccdbfaaea3', '3428a972-2df1-436f-ae07-69123bc916d8', '8d55152e-b85c-4078-845a-dba875c97525'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-16da472d-f208-4047-b43a-259aa02c9bd6 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-16da472d-f208-4047-b43a-259aa02c9bd6 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-16da472d-f208-4047-b43a-259aa02c9bd6 tempest-ProjectMemberTests-2128151930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-16da472d-f208-4047-b43a-259aa02c9bd6 tempest-ProjectMemberTests-2128151930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-16da472d-f208-4047-b43a-259aa02c9bd6 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-16da472d-f208-4047-b43a-259aa02c9bd6 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:18 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:12:18 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:18 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-16da472d-f208-4047-b43a-259aa02c9bd6 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.279s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-16da472d-f208-4047-b43a-259aa02c9bd6 tempest-ProjectMemberTests-2128151930 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:12:18 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-16da472d-f208-4047-b43a-259aa02c9bd6 tempest-ProjectMemberTests-2128151930 None] Deleted volume successfully. Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-16da472d-f208-4047-b43a-259aa02c9bd6 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-8351b4b4-fb97-408b-a7f9-7fbf9a7fd2ae-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Flow 'volume_create_manager' (fbb0e744-cdfc-4d36-934f-6d0f7f20f3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae3424ab-e8b8-4062-a3bd-a3bfc99f1dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae3424ab-e8b8-4062-a3bd-a3bfc99f1dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1013017094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d13a748-9895-4f56-bebe-cbbc61f1e9d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3ab3953afc4ba588a5a6758fef10a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:12:19Z,use_quota=True,user_id='8da888e194c942a6896757d64cd62196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf43772-d8c2-46c3-babb-857ad97ab30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf43772-d8c2-46c3-babb-857ad97ab30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c70c2769-a61f-4c90-896f-2a64642720d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c70c2769-a61f-4c90-896f-2a64642720d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d13a748-9895-4f56-bebe-cbbc61f1e9d5', 'volume_name': 'volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11e2ee5-bf94-4628-b12e-9d5d296ac113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11e2ee5-bf94-4628-b12e-9d5d296ac113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2822a796-951f-4bf7-8697-5cdaffc36402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:18 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Volume 7d13a748-9895-4f56-bebe-cbbc61f1e9d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5', 'volume_size': 1} Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1013017094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d13a748-9895-4f56-bebe-cbbc61f1e9d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3ab3953afc4ba588a5a6758fef10a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:12:19Z,use_quota=True,user_id='8da888e194c942a6896757d64cd62196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Creating volume 7d13a748-9895-4f56-bebe-cbbc61f1e9d5 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:12:18 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:12:18 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:18 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5 1073741824 Sep 21 12:12:18 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:19 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5 1073741824" returned: 0 in 0.447s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:19 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5 Sep 21 12:12:19 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:19 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5" returned: 0 in 0.279s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:19 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:12:19 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2822a796-951f-4bf7-8697-5cdaffc36402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0856f031-d0a9-43e4-b246-dbeed46ae241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:19 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Volume volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5 (7d13a748-9895-4f56-bebe-cbbc61f1e9d5): created successfully Sep 21 12:12:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0856f031-d0a9-43e4-b246-dbeed46ae241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:19 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Flow 'volume_create_manager' (fbb0e744-cdfc-4d36-934f-6d0f7f20f3dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:12:19 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-87329d82-fab7-4b2a-a090-d8658f93c986 tempest-ProjectMemberTests-2128151930 None] Created volume successfully. Sep 21 12:12:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2943c16d-d0eb-4e79-afb5-28eb4f22d0da tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2943c16d-d0eb-4e79-afb5-28eb4f22d0da tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:21 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-2943c16d-d0eb-4e79-afb5-28eb4f22d0da tempest-ProjectMemberTests-2128151930 None] Creating offline snapshot 9382b670-73f5-48a9-8740-09a6daaf062c of volume 7d13a748-9895-4f56-bebe-cbbc61f1e9d5 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:12:21 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fee2b9-bb11-43d7-9b28-951e87cd76f9]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2943c16d-d0eb-4e79-afb5-28eb4f22d0da tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:21 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5 Sep 21 12:12:21 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:21 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2943c16d-d0eb-4e79-afb5-28eb4f22d0da tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5" returned: 0 in 0.401s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2943c16d-d0eb-4e79-afb5-28eb4f22d0da tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5.9382b670-73f5-48a9-8740-09a6daaf062c 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:21 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5.9382b670-73f5-48a9-8740-09a6daaf062c 1G Sep 21 12:12:21 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:21 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2943c16d-d0eb-4e79-afb5-28eb4f22d0da tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5.9382b670-73f5-48a9-8740-09a6daaf062c 1G" returned: 0 in 0.398s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:21 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2943c16d-d0eb-4e79-afb5-28eb4f22d0da tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5.9382b670-73f5-48a9-8740-09a6daaf062c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:21 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5.9382b670-73f5-48a9-8740-09a6daaf062c Sep 21 12:12:21 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:22 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2943c16d-d0eb-4e79-afb5-28eb4f22d0da tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5.9382b670-73f5-48a9-8740-09a6daaf062c" returned: 0 in 0.435s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:22 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-2943c16d-d0eb-4e79-afb5-28eb4f22d0da tempest-ProjectMemberTests-2128151930 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5.9382b670-73f5-48a9-8740-09a6daaf062c is being set with open permissions: ugo+rw Sep 21 12:12:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2943c16d-d0eb-4e79-afb5-28eb4f22d0da tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5.9382b670-73f5-48a9-8740-09a6daaf062c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:22 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5.9382b670-73f5-48a9-8740-09a6daaf062c Sep 21 12:12:22 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:22 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2943c16d-d0eb-4e79-afb5-28eb4f22d0da tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5.9382b670-73f5-48a9-8740-09a6daaf062c" returned: 0 in 0.260s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2943c16d-d0eb-4e79-afb5-28eb4f22d0da tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:22 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5.info Sep 21 12:12:22 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:22 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2943c16d-d0eb-4e79-afb5-28eb4f22d0da tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5.info" returned: 0 in 0.255s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:22 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-2943c16d-d0eb-4e79-afb5-28eb4f22d0da tempest-ProjectMemberTests-2128151930 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5.info is being set with open permissions: ugo+rw Sep 21 12:12:22 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2943c16d-d0eb-4e79-afb5-28eb4f22d0da tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:22 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5.info Sep 21 12:12:22 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:23 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2943c16d-d0eb-4e79-afb5-28eb4f22d0da tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5.info" returned: 0 in 0.258s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:23 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2943c16d-d0eb-4e79-afb5-28eb4f22d0da tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.109s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:23 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-2943c16d-d0eb-4e79-afb5-28eb4f22d0da tempest-ProjectMemberTests-2128151930 None] Create snapshot completed successfully Sep 21 12:12:24 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9130a285-46d0-4b84-862e-64509a81ff73 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-9382b670-73f5-48a9-8740-09a6daaf062c-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:24 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9130a285-46d0-4b84-862e-64509a81ff73 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-9382b670-73f5-48a9-8740-09a6daaf062c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:24 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9130a285-46d0-4b84-862e-64509a81ff73 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-quobyte-7d13a748-9895-4f56-bebe-cbbc61f1e9d5" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:24 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9130a285-46d0-4b84-862e-64509a81ff73 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-7d13a748-9895-4f56-bebe-cbbc61f1e9d5" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:24 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9130a285-46d0-4b84-862e-64509a81ff73 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-quobyte-9382b670-73f5-48a9-8740-09a6daaf062c" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:24 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9130a285-46d0-4b84-862e-64509a81ff73 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-9382b670-73f5-48a9-8740-09a6daaf062c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:24 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-9130a285-46d0-4b84-862e-64509a81ff73 tempest-ProjectMemberTests-2128151930 None] Deleting offline snapshot 9382b670-73f5-48a9-8740-09a6daaf062c of volume 7d13a748-9895-4f56-bebe-cbbc61f1e9d5 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:12:24 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-9130a285-46d0-4b84-862e-64509a81ff73 tempest-ProjectMemberTests-2128151930 None] snapshot_file for this snap is: volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5.9382b670-73f5-48a9-8740-09a6daaf062c {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:12:24 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[08dbe975-f3b8-4259-b182-875f73f34209]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9130a285-46d0-4b84-862e-64509a81ff73 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5.9382b670-73f5-48a9-8740-09a6daaf062c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:24 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5.9382b670-73f5-48a9-8740-09a6daaf062c Sep 21 12:12:24 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:24 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9130a285-46d0-4b84-862e-64509a81ff73 tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5.9382b670-73f5-48a9-8740-09a6daaf062c" returned: 0 in 0.416s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:24 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-9130a285-46d0-4b84-862e-64509a81ff73 tempest-ProjectMemberTests-2128151930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:12:24 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[1375f099-526f-4ebc-93b2-60ef9e5038aa]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:24 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9130a285-46d0-4b84-862e-64509a81ff73 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:24 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5 Sep 21 12:12:24 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:25 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9130a285-46d0-4b84-862e-64509a81ff73 tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5" returned: 0 in 0.383s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9130a285-46d0-4b84-862e-64509a81ff73 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5.9382b670-73f5-48a9-8740-09a6daaf062c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:25 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5.9382b670-73f5-48a9-8740-09a6daaf062c Sep 21 12:12:25 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:25 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9130a285-46d0-4b84-862e-64509a81ff73 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5.9382b670-73f5-48a9-8740-09a6daaf062c" returned: 0 in 0.373s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9130a285-46d0-4b84-862e-64509a81ff73 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5.9382b670-73f5-48a9-8740-09a6daaf062c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:25 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5.9382b670-73f5-48a9-8740-09a6daaf062c Sep 21 12:12:25 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:25 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:25 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9130a285-46d0-4b84-862e-64509a81ff73 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5.9382b670-73f5-48a9-8740-09a6daaf062c" returned: 0 in 0.287s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:25 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9130a285-46d0-4b84-862e-64509a81ff73 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-9382b670-73f5-48a9-8740-09a6daaf062c" released by "_delete_snapshot" :: held 1.574s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:25 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9130a285-46d0-4b84-862e-64509a81ff73 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-7d13a748-9895-4f56-bebe-cbbc61f1e9d5" released by "delete_snapshot" :: held 1.602s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:26 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-9130a285-46d0-4b84-862e-64509a81ff73 tempest-ProjectMemberTests-2128151930 None] Created reservations ['c7dfc5e5-80d1-4f6c-bad0-2fb635313656', 'ed285dbc-ef3b-4754-8fff-9aaa93266c42', '3784cf45-f526-497d-a149-2ee189ac3c43', '93943270-3e4e-4019-8638-831bc8a5a255'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:12:26 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-9130a285-46d0-4b84-862e-64509a81ff73 tempest-ProjectMemberTests-2128151930 None] Delete snapshot completed successfully. Sep 21 12:12:26 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9130a285-46d0-4b84-862e-64509a81ff73 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-9382b670-73f5-48a9-8740-09a6daaf062c-delete_snapshot" released by "delete_snapshot" :: held 1.755s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:26 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-415be8bd-344f-49bf-a17b-65c6f143aa8c tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-7d13a748-9895-4f56-bebe-cbbc61f1e9d5-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:26 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-415be8bd-344f-49bf-a17b-65c6f143aa8c tempest-ProjectMemberTests-2128151930 None] Lock "cinder-7d13a748-9895-4f56-bebe-cbbc61f1e9d5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:26 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-415be8bd-344f-49bf-a17b-65c6f143aa8c tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-quobyte-7d13a748-9895-4f56-bebe-cbbc61f1e9d5" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:26 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-415be8bd-344f-49bf-a17b-65c6f143aa8c tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-7d13a748-9895-4f56-bebe-cbbc61f1e9d5" acquired by "delete_volume" :: waited 0.021s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:26 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f66dc9-f7a0-48d1-9f40-fe1c10ae6c56]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:26 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-415be8bd-344f-49bf-a17b-65c6f143aa8c tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:26 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5 Sep 21 12:12:26 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:27 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-415be8bd-344f-49bf-a17b-65c6f143aa8c tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5" returned: 0 in 0.417s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-415be8bd-344f-49bf-a17b-65c6f143aa8c tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:27 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5 Sep 21 12:12:27 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:27 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-415be8bd-344f-49bf-a17b-65c6f143aa8c tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-7d13a748-9895-4f56-bebe-cbbc61f1e9d5" returned: 0 in 0.260s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:27 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-415be8bd-344f-49bf-a17b-65c6f143aa8c tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-7d13a748-9895-4f56-bebe-cbbc61f1e9d5" released by "delete_volume" :: held 0.762s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:27 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-415be8bd-344f-49bf-a17b-65c6f143aa8c tempest-ProjectMemberTests-2128151930 None] Created reservations ['a61e82bd-cc8f-41cb-ac14-2e4ba424e681', 'c71d8aa1-7e82-41a8-95bf-de47d0f82500', 'aa7ba039-5614-45a1-943b-e90e6cae729e', '8c2fb9ce-90b7-4fa7-a6ef-af341e3350e7'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:12:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-415be8bd-344f-49bf-a17b-65c6f143aa8c tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-415be8bd-344f-49bf-a17b-65c6f143aa8c tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-415be8bd-344f-49bf-a17b-65c6f143aa8c tempest-ProjectMemberTests-2128151930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:12:27 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-415be8bd-344f-49bf-a17b-65c6f143aa8c tempest-ProjectMemberTests-2128151930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:12:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-415be8bd-344f-49bf-a17b-65c6f143aa8c tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-415be8bd-344f-49bf-a17b-65c6f143aa8c tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:27 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:12:27 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:27 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:27 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-415be8bd-344f-49bf-a17b-65c6f143aa8c tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.314s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:27 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-415be8bd-344f-49bf-a17b-65c6f143aa8c tempest-ProjectMemberTests-2128151930 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:12:27 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-415be8bd-344f-49bf-a17b-65c6f143aa8c tempest-ProjectMemberTests-2128151930 None] Deleted volume successfully. Sep 21 12:12:27 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-415be8bd-344f-49bf-a17b-65c6f143aa8c tempest-ProjectMemberTests-2128151930 None] Lock "cinder-7d13a748-9895-4f56-bebe-cbbc61f1e9d5-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:28 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:12:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Flow 'volume_create_manager' (b70f1223-71d5-4d03-8512-5fdb4538eb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:12:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d2eea0-f8a9-48e8-ac00-d75dfc19ea82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d2eea0-f8a9-48e8-ac00-d75dfc19ea82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1924492824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602072bf-5a76-43b6-94b4-d3cc347b83d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3ab3953afc4ba588a5a6758fef10a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:12:28Z,use_quota=True,user_id='8da888e194c942a6896757d64cd62196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee0f627-4ad3-49ec-a7af-bb29360362b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee0f627-4ad3-49ec-a7af-bb29360362b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c655cb-b3a6-4956-a5f5-1a1a03c360ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c655cb-b3a6-4956-a5f5-1a1a03c360ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '602072bf-5a76-43b6-94b4-d3cc347b83d7', 'volume_name': 'volume-602072bf-5a76-43b6-94b4-d3cc347b83d7', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566c388b-03d0-4f0b-83b0-244b8ffda95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566c388b-03d0-4f0b-83b0-244b8ffda95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:28 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e26090b-f27f-42d4-b015-b1fa501c0347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:28 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Volume 602072bf-5a76-43b6-94b4-d3cc347b83d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-602072bf-5a76-43b6-94b4-d3cc347b83d7', 'volume_size': 1} Sep 21 12:12:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:28 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1924492824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602072bf-5a76-43b6-94b4-d3cc347b83d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3ab3953afc4ba588a5a6758fef10a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:12:28Z,use_quota=True,user_id='8da888e194c942a6896757d64cd62196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:12:28 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Creating volume 602072bf-5a76-43b6-94b4-d3cc347b83d7 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:12:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:28 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:12:28 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:12:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:28 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:12:28 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:12:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:28 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7 1073741824 Sep 21 12:12:28 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:28 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7 1073741824" returned: 0 in 0.432s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:28 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:28 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7 Sep 21 12:12:28 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:29 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7" returned: 0 in 0.264s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:12:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e26090b-f27f-42d4-b015-b1fa501c0347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-602072bf-5a76-43b6-94b4-d3cc347b83d7', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1338d5c-ceff-4879-95d5-0150d2c2798d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:29 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Volume volume-602072bf-5a76-43b6-94b4-d3cc347b83d7 (602072bf-5a76-43b6-94b4-d3cc347b83d7): created successfully Sep 21 12:12:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1338d5c-ceff-4879-95d5-0150d2c2798d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:29 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Flow 'volume_create_manager' (b70f1223-71d5-4d03-8512-5fdb4538eb66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:12:29 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-b10082f0-b3e7-4e55-8b9d-b86f464183b7 tempest-ProjectMemberTests-2128151930 None] Created volume successfully. Sep 21 12:12:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d65005f8-f9db-4546-8af4-2d67fcd16a96 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d65005f8-f9db-4546-8af4-2d67fcd16a96 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:29 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-d65005f8-f9db-4546-8af4-2d67fcd16a96 tempest-ProjectMemberTests-2128151930 None] Creating offline snapshot 0331d929-65bd-4462-89d9-bea7a7704895 of volume 602072bf-5a76-43b6-94b4-d3cc347b83d7 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:12:29 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf68faa-09d3-4fd7-93f7-8f6da504b6c8]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d65005f8-f9db-4546-8af4-2d67fcd16a96 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:29 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7 Sep 21 12:12:29 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:29 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d65005f8-f9db-4546-8af4-2d67fcd16a96 tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7" returned: 0 in 0.411s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:29 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d65005f8-f9db-4546-8af4-2d67fcd16a96 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7.0331d929-65bd-4462-89d9-bea7a7704895 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:29 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7.0331d929-65bd-4462-89d9-bea7a7704895 1G Sep 21 12:12:29 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:30 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d65005f8-f9db-4546-8af4-2d67fcd16a96 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7.0331d929-65bd-4462-89d9-bea7a7704895 1G" returned: 0 in 0.416s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d65005f8-f9db-4546-8af4-2d67fcd16a96 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-602072bf-5a76-43b6-94b4-d3cc347b83d7 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7.0331d929-65bd-4462-89d9-bea7a7704895 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:30 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-602072bf-5a76-43b6-94b4-d3cc347b83d7 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7.0331d929-65bd-4462-89d9-bea7a7704895 Sep 21 12:12:30 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:30 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d65005f8-f9db-4546-8af4-2d67fcd16a96 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-602072bf-5a76-43b6-94b4-d3cc347b83d7 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7.0331d929-65bd-4462-89d9-bea7a7704895" returned: 0 in 0.313s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:30 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-d65005f8-f9db-4546-8af4-2d67fcd16a96 tempest-ProjectMemberTests-2128151930 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7.0331d929-65bd-4462-89d9-bea7a7704895 is being set with open permissions: ugo+rw Sep 21 12:12:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d65005f8-f9db-4546-8af4-2d67fcd16a96 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7.0331d929-65bd-4462-89d9-bea7a7704895 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:30 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7.0331d929-65bd-4462-89d9-bea7a7704895 Sep 21 12:12:30 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:30 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d65005f8-f9db-4546-8af4-2d67fcd16a96 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7.0331d929-65bd-4462-89d9-bea7a7704895" returned: 0 in 0.254s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:30 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d65005f8-f9db-4546-8af4-2d67fcd16a96 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:30 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7.info Sep 21 12:12:30 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:31 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d65005f8-f9db-4546-8af4-2d67fcd16a96 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7.info" returned: 0 in 0.272s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:31 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-d65005f8-f9db-4546-8af4-2d67fcd16a96 tempest-ProjectMemberTests-2128151930 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7.info is being set with open permissions: ugo+rw Sep 21 12:12:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d65005f8-f9db-4546-8af4-2d67fcd16a96 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:31 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7.info Sep 21 12:12:31 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:31 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-d65005f8-f9db-4546-8af4-2d67fcd16a96 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7.info" returned: 0 in 0.250s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-d65005f8-f9db-4546-8af4-2d67fcd16a96 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.013s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:31 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-d65005f8-f9db-4546-8af4-2d67fcd16a96 tempest-ProjectMemberTests-2128151930 None] Create snapshot completed successfully Sep 21 12:12:31 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-01a70ed7-e4e1-4884-9d63-94624c622403 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-0331d929-65bd-4462-89d9-bea7a7704895-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:31 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-01a70ed7-e4e1-4884-9d63-94624c622403 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-0331d929-65bd-4462-89d9-bea7a7704895-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:31 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-01a70ed7-e4e1-4884-9d63-94624c622403 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-quobyte-602072bf-5a76-43b6-94b4-d3cc347b83d7" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:31 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-01a70ed7-e4e1-4884-9d63-94624c622403 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-602072bf-5a76-43b6-94b4-d3cc347b83d7" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:31 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-01a70ed7-e4e1-4884-9d63-94624c622403 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-quobyte-0331d929-65bd-4462-89d9-bea7a7704895" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:31 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-01a70ed7-e4e1-4884-9d63-94624c622403 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-0331d929-65bd-4462-89d9-bea7a7704895" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-01a70ed7-e4e1-4884-9d63-94624c622403 tempest-ProjectMemberTests-2128151930 None] Deleting offline snapshot 0331d929-65bd-4462-89d9-bea7a7704895 of volume 602072bf-5a76-43b6-94b4-d3cc347b83d7 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:12:31 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-01a70ed7-e4e1-4884-9d63-94624c622403 tempest-ProjectMemberTests-2128151930 None] snapshot_file for this snap is: volume-602072bf-5a76-43b6-94b4-d3cc347b83d7.0331d929-65bd-4462-89d9-bea7a7704895 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:12:31 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[416b9f94-5859-468a-b04e-8566bd9629f1]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:31 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-01a70ed7-e4e1-4884-9d63-94624c622403 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7.0331d929-65bd-4462-89d9-bea7a7704895 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:31 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7.0331d929-65bd-4462-89d9-bea7a7704895 Sep 21 12:12:31 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:32 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-01a70ed7-e4e1-4884-9d63-94624c622403 tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7.0331d929-65bd-4462-89d9-bea7a7704895" returned: 0 in 0.399s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:32 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-01a70ed7-e4e1-4884-9d63-94624c622403 tempest-ProjectMemberTests-2128151930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-602072bf-5a76-43b6-94b4-d3cc347b83d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:12:32 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[66038e6d-a6bd-4b57-8d8b-dee5b7489c13]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-01a70ed7-e4e1-4884-9d63-94624c622403 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:32 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7 Sep 21 12:12:32 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:32 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-01a70ed7-e4e1-4884-9d63-94624c622403 tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7" returned: 0 in 0.361s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-01a70ed7-e4e1-4884-9d63-94624c622403 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7.0331d929-65bd-4462-89d9-bea7a7704895 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:32 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7.0331d929-65bd-4462-89d9-bea7a7704895 Sep 21 12:12:32 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:32 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-01a70ed7-e4e1-4884-9d63-94624c622403 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7.0331d929-65bd-4462-89d9-bea7a7704895" returned: 0 in 0.337s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:32 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-01a70ed7-e4e1-4884-9d63-94624c622403 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7.0331d929-65bd-4462-89d9-bea7a7704895 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:32 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7.0331d929-65bd-4462-89d9-bea7a7704895 Sep 21 12:12:32 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:33 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-01a70ed7-e4e1-4884-9d63-94624c622403 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7.0331d929-65bd-4462-89d9-bea7a7704895" returned: 0 in 0.331s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-01a70ed7-e4e1-4884-9d63-94624c622403 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-0331d929-65bd-4462-89d9-bea7a7704895" released by "_delete_snapshot" :: held 1.544s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-01a70ed7-e4e1-4884-9d63-94624c622403 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-602072bf-5a76-43b6-94b4-d3cc347b83d7" released by "delete_snapshot" :: held 1.565s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:33 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-01a70ed7-e4e1-4884-9d63-94624c622403 tempest-ProjectMemberTests-2128151930 None] Created reservations ['35dfcf62-b030-4e57-8857-c17f080787b7', 'd105e472-f06c-4f25-bf6b-fc8834907324', '5f311fba-32d8-40e0-8543-6f6467566361', '5fd5db72-9156-48a0-81e7-07552c3a3cd5'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:12:33 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-01a70ed7-e4e1-4884-9d63-94624c622403 tempest-ProjectMemberTests-2128151930 None] Delete snapshot completed successfully. Sep 21 12:12:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-01a70ed7-e4e1-4884-9d63-94624c622403 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-0331d929-65bd-4462-89d9-bea7a7704895-delete_snapshot" released by "delete_snapshot" :: held 1.738s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-84d6a359-1945-4212-a049-3cb0fc46ba8c tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-602072bf-5a76-43b6-94b4-d3cc347b83d7-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-84d6a359-1945-4212-a049-3cb0fc46ba8c tempest-ProjectMemberTests-2128151930 None] Lock "cinder-602072bf-5a76-43b6-94b4-d3cc347b83d7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-84d6a359-1945-4212-a049-3cb0fc46ba8c tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-quobyte-602072bf-5a76-43b6-94b4-d3cc347b83d7" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:33 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-84d6a359-1945-4212-a049-3cb0fc46ba8c tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-602072bf-5a76-43b6-94b4-d3cc347b83d7" acquired by "delete_volume" :: waited 0.021s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:33 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe775c50-1dea-4f57-b673-4f90a30b6e62]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:33 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-84d6a359-1945-4212-a049-3cb0fc46ba8c tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:34 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7 Sep 21 12:12:34 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:34 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-84d6a359-1945-4212-a049-3cb0fc46ba8c tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7" returned: 0 in 0.438s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-84d6a359-1945-4212-a049-3cb0fc46ba8c tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:34 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7 Sep 21 12:12:34 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:34 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-84d6a359-1945-4212-a049-3cb0fc46ba8c tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-602072bf-5a76-43b6-94b4-d3cc347b83d7" returned: 0 in 0.355s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:34 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-84d6a359-1945-4212-a049-3cb0fc46ba8c tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-602072bf-5a76-43b6-94b4-d3cc347b83d7" released by "delete_volume" :: held 0.886s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:34 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-84d6a359-1945-4212-a049-3cb0fc46ba8c tempest-ProjectMemberTests-2128151930 None] Created reservations ['0b728732-88b1-49db-89f8-ea6a744386af', 'dfa0d524-f8dd-43a5-8cdb-a2056b7a34a3', 'cbbdb47a-d720-4ec5-9d2d-33d3579bd67d', '1f05e35e-4b8a-4f30-adbf-16c418863ee6'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:12:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-84d6a359-1945-4212-a049-3cb0fc46ba8c tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-84d6a359-1945-4212-a049-3cb0fc46ba8c tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:34 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-84d6a359-1945-4212-a049-3cb0fc46ba8c tempest-ProjectMemberTests-2128151930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:12:34 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-84d6a359-1945-4212-a049-3cb0fc46ba8c tempest-ProjectMemberTests-2128151930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:12:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-84d6a359-1945-4212-a049-3cb0fc46ba8c tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:34 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-84d6a359-1945-4212-a049-3cb0fc46ba8c tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:34 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:12:34 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:35 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-84d6a359-1945-4212-a049-3cb0fc46ba8c tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.347s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:35 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-84d6a359-1945-4212-a049-3cb0fc46ba8c tempest-ProjectMemberTests-2128151930 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:12:35 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-84d6a359-1945-4212-a049-3cb0fc46ba8c tempest-ProjectMemberTests-2128151930 None] Deleted volume successfully. Sep 21 12:12:35 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-84d6a359-1945-4212-a049-3cb0fc46ba8c tempest-ProjectMemberTests-2128151930 None] Lock "cinder-602072bf-5a76-43b6-94b4-d3cc347b83d7-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:35 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:12:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Flow 'volume_create_manager' (a1926c23-d260-49c0-b9d5-83dd8f7e9cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:12:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e666c6c0-fc47-41cb-b337-a72f1ca6f414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e666c6c0-fc47-41cb-b337-a72f1ca6f414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-237933139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f417c0c-89ae-46cc-8aac-de7a4c2a0dda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3ab3953afc4ba588a5a6758fef10a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:12:35Z,use_quota=True,user_id='8da888e194c942a6896757d64cd62196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c87a34a8-9bfd-4804-a22e-00aabe7f89f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c87a34a8-9bfd-4804-a22e-00aabe7f89f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d09969d-8271-4e92-8c04-81ff7f166242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d09969d-8271-4e92-8c04-81ff7f166242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f417c0c-89ae-46cc-8aac-de7a4c2a0dda', 'volume_name': 'volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a99f03-33b7-4472-ae0e-752a89cb5797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a99f03-33b7-4472-ae0e-752a89cb5797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:35 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16eedae-78bf-499c-af07-ee4c0e3d88d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:35 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Volume 1f417c0c-89ae-46cc-8aac-de7a4c2a0dda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda', 'volume_size': 1} Sep 21 12:12:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-237933139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f417c0c-89ae-46cc-8aac-de7a4c2a0dda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3ab3953afc4ba588a5a6758fef10a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:12:35Z,use_quota=True,user_id='8da888e194c942a6896757d64cd62196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:12:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Creating volume 1f417c0c-89ae-46cc-8aac-de7a4c2a0dda {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:12:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:12:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:12:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:35 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:12:35 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:12:35 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:35 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda 1073741824 Sep 21 12:12:35 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:36 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda 1073741824" returned: 0 in 0.487s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:36 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda Sep 21 12:12:36 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:36 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda" returned: 0 in 0.246s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:36 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:12:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:36 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16eedae-78bf-499c-af07-ee4c0e3d88d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:36 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22208c77-7903-4e96-8f20-5eba7d7c2201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:36 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Volume volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda (1f417c0c-89ae-46cc-8aac-de7a4c2a0dda): created successfully Sep 21 12:12:36 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22208c77-7903-4e96-8f20-5eba7d7c2201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:36 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Flow 'volume_create_manager' (a1926c23-d260-49c0-b9d5-83dd8f7e9cf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:12:36 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-174b94e3-cabf-4bc6-9d78-6e6ae8df33c8 tempest-ProjectMemberTests-2128151930 None] Created volume successfully. Sep 21 12:12:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3eceedab-a688-4fb6-95b9-b7d14a5ff723 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3eceedab-a688-4fb6-95b9-b7d14a5ff723 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:36 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-3eceedab-a688-4fb6-95b9-b7d14a5ff723 tempest-ProjectMemberTests-2128151930 None] Creating offline snapshot dff98c99-7c4d-4e68-9f10-35dd75d399b2 of volume 1f417c0c-89ae-46cc-8aac-de7a4c2a0dda {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:12:36 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb152fd7-e232-431c-8351-baae404bb9ed]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:36 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3eceedab-a688-4fb6-95b9-b7d14a5ff723 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:36 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda Sep 21 12:12:36 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:37 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3eceedab-a688-4fb6-95b9-b7d14a5ff723 tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda" returned: 0 in 0.456s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3eceedab-a688-4fb6-95b9-b7d14a5ff723 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda.dff98c99-7c4d-4e68-9f10-35dd75d399b2 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:37 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda.dff98c99-7c4d-4e68-9f10-35dd75d399b2 1G Sep 21 12:12:37 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:37 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3eceedab-a688-4fb6-95b9-b7d14a5ff723 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda.dff98c99-7c4d-4e68-9f10-35dd75d399b2 1G" returned: 0 in 0.518s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:37 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3eceedab-a688-4fb6-95b9-b7d14a5ff723 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda.dff98c99-7c4d-4e68-9f10-35dd75d399b2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:37 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda.dff98c99-7c4d-4e68-9f10-35dd75d399b2 Sep 21 12:12:37 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:38 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3eceedab-a688-4fb6-95b9-b7d14a5ff723 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda.dff98c99-7c4d-4e68-9f10-35dd75d399b2" returned: 0 in 0.336s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:38 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-3eceedab-a688-4fb6-95b9-b7d14a5ff723 tempest-ProjectMemberTests-2128151930 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda.dff98c99-7c4d-4e68-9f10-35dd75d399b2 is being set with open permissions: ugo+rw Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3eceedab-a688-4fb6-95b9-b7d14a5ff723 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda.dff98c99-7c4d-4e68-9f10-35dd75d399b2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:38 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda.dff98c99-7c4d-4e68-9f10-35dd75d399b2 Sep 21 12:12:38 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Flow 'volume_create_manager' (542c9dd6-e0d7-4982-b45a-8cd1a7888d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:12:38 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc572381-7cae-4425-ae43-317a10864f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3eceedab-a688-4fb6-95b9-b7d14a5ff723 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda.dff98c99-7c4d-4e68-9f10-35dd75d399b2" returned: 0 in 0.292s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc572381-7cae-4425-ae43-317a10864f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1903782074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=375f7043-a02e-46d3-b79d-1587a9965521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f26d0e431abf43b5b1f1b72faf088e8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:12:38Z,use_quota=True,user_id='be9108cc572d4c68b94b103e38953dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8205651-6bb3-4578-8ca9-d798706afaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8205651-6bb3-4578-8ca9-d798706afaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7416e510-ec82-4580-9bdc-65f903a28ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7416e510-ec82-4580-9bdc-65f903a28ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '375f7043-a02e-46d3-b79d-1587a9965521', 'volume_name': 'volume-375f7043-a02e-46d3-b79d-1587a9965521', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4c143c-3a22-498f-bb1b-50487803dea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4c143c-3a22-498f-bb1b-50487803dea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1caab964-e05b-4eca-85fe-fec3a214606c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:38 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Volume 375f7043-a02e-46d3-b79d-1587a9965521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-375f7043-a02e-46d3-b79d-1587a9965521', 'volume_size': 1} Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3eceedab-a688-4fb6-95b9-b7d14a5ff723 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:38 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda.info Sep 21 12:12:38 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:38 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3eceedab-a688-4fb6-95b9-b7d14a5ff723 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda.info" returned: 0 in 0.268s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:38 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-3eceedab-a688-4fb6-95b9-b7d14a5ff723 tempest-ProjectMemberTests-2128151930 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda.info is being set with open permissions: ugo+rw Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3eceedab-a688-4fb6-95b9-b7d14a5ff723 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:38 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda.info Sep 21 12:12:38 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:38 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3eceedab-a688-4fb6-95b9-b7d14a5ff723 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda.info" returned: 0 in 0.259s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3eceedab-a688-4fb6-95b9-b7d14a5ff723 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.276s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.567s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1903782074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=375f7043-a02e-46d3-b79d-1587a9965521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f26d0e431abf43b5b1f1b72faf088e8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:12:38Z,use_quota=True,user_id='be9108cc572d4c68b94b103e38953dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Creating volume 375f7043-a02e-46d3-b79d-1587a9965521 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:12:38 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:12:38 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:39 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521 1073741824 Sep 21 12:12:39 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:39 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-3eceedab-a688-4fb6-95b9-b7d14a5ff723 tempest-ProjectMemberTests-2128151930 None] Create snapshot completed successfully Sep 21 12:12:39 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521 1073741824" returned: 0 in 0.450s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:39 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521 Sep 21 12:12:39 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:39 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521" returned: 0 in 0.242s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:39 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:12:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1caab964-e05b-4eca-85fe-fec3a214606c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-375f7043-a02e-46d3-b79d-1587a9965521', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcd0e2c8-8307-41a3-8e2e-3d0231696d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:39 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Volume volume-375f7043-a02e-46d3-b79d-1587a9965521 (375f7043-a02e-46d3-b79d-1587a9965521): created successfully Sep 21 12:12:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcd0e2c8-8307-41a3-8e2e-3d0231696d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:39 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Flow 'volume_create_manager' (542c9dd6-e0d7-4982-b45a-8cd1a7888d0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:12:39 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-18faef7f-bbc5-4ce5-988b-aeaf3c429078 tempest-SnapshotDependencyTests-65646176 None] Created volume successfully. Sep 21 12:12:39 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1f556c7e-4ae0-4a10-83b6-98235a0044cf tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-dff98c99-7c4d-4e68-9f10-35dd75d399b2-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:39 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1f556c7e-4ae0-4a10-83b6-98235a0044cf tempest-ProjectMemberTests-2128151930 None] Lock "cinder-dff98c99-7c4d-4e68-9f10-35dd75d399b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:39 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1f556c7e-4ae0-4a10-83b6-98235a0044cf tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-quobyte-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:39 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1f556c7e-4ae0-4a10-83b6-98235a0044cf tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:39 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1f556c7e-4ae0-4a10-83b6-98235a0044cf tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-quobyte-dff98c99-7c4d-4e68-9f10-35dd75d399b2" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:39 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1f556c7e-4ae0-4a10-83b6-98235a0044cf tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-dff98c99-7c4d-4e68-9f10-35dd75d399b2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:39 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1f556c7e-4ae0-4a10-83b6-98235a0044cf tempest-ProjectMemberTests-2128151930 None] Deleting offline snapshot dff98c99-7c4d-4e68-9f10-35dd75d399b2 of volume 1f417c0c-89ae-46cc-8aac-de7a4c2a0dda {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:12:39 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1f556c7e-4ae0-4a10-83b6-98235a0044cf tempest-ProjectMemberTests-2128151930 None] snapshot_file for this snap is: volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda.dff98c99-7c4d-4e68-9f10-35dd75d399b2 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:12:39 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[e890b20c-ec25-472d-ac49-cf8d812ce02d]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:39 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f556c7e-4ae0-4a10-83b6-98235a0044cf tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda.dff98c99-7c4d-4e68-9f10-35dd75d399b2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:40 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda.dff98c99-7c4d-4e68-9f10-35dd75d399b2 Sep 21 12:12:40 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:40 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f556c7e-4ae0-4a10-83b6-98235a0044cf tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda.dff98c99-7c4d-4e68-9f10-35dd75d399b2" returned: 0 in 0.362s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:40 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-1f556c7e-4ae0-4a10-83b6-98235a0044cf tempest-ProjectMemberTests-2128151930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:12:40 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[261f6a8a-a841-4103-a1f4-4836efaf4179]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f556c7e-4ae0-4a10-83b6-98235a0044cf tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:40 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda Sep 21 12:12:40 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0286c588-499c-4518-8d67-ab0a0662fcc9 tempest-SnapshotDependencyTests-65646176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0286c588-499c-4518-8d67-ab0a0662fcc9 tempest-SnapshotDependencyTests-65646176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:40 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-0286c588-499c-4518-8d67-ab0a0662fcc9 tempest-SnapshotDependencyTests-65646176 None] Creating offline snapshot 1762b315-a665-49f1-9c5f-93f53451fc36 of volume 375f7043-a02e-46d3-b79d-1587a9965521 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:12:40 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:40 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c0cce0-95da-4695-84ba-10faf2351ea8]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0286c588-499c-4518-8d67-ab0a0662fcc9 tempest-SnapshotDependencyTests-65646176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f556c7e-4ae0-4a10-83b6-98235a0044cf tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda" returned: 0 in 0.389s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:40 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f556c7e-4ae0-4a10-83b6-98235a0044cf tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda.dff98c99-7c4d-4e68-9f10-35dd75d399b2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:40 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda.dff98c99-7c4d-4e68-9f10-35dd75d399b2 Sep 21 12:12:40 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:40 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521 Sep 21 12:12:40 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:41 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0286c588-499c-4518-8d67-ab0a0662fcc9 tempest-SnapshotDependencyTests-65646176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521" returned: 0 in 0.372s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0286c588-499c-4518-8d67-ab0a0662fcc9 tempest-SnapshotDependencyTests-65646176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.1762b315-a665-49f1-9c5f-93f53451fc36 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:41 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f556c7e-4ae0-4a10-83b6-98235a0044cf tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda.dff98c99-7c4d-4e68-9f10-35dd75d399b2" returned: 0 in 0.373s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f556c7e-4ae0-4a10-83b6-98235a0044cf tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda.dff98c99-7c4d-4e68-9f10-35dd75d399b2 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:41 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.1762b315-a665-49f1-9c5f-93f53451fc36 1G Sep 21 12:12:41 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:41 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda.dff98c99-7c4d-4e68-9f10-35dd75d399b2 Sep 21 12:12:41 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:41 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-1f556c7e-4ae0-4a10-83b6-98235a0044cf tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda.dff98c99-7c4d-4e68-9f10-35dd75d399b2" returned: 0 in 0.255s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:41 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1f556c7e-4ae0-4a10-83b6-98235a0044cf tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-dff98c99-7c4d-4e68-9f10-35dd75d399b2" released by "_delete_snapshot" :: held 1.502s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:41 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1f556c7e-4ae0-4a10-83b6-98235a0044cf tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda" released by "delete_snapshot" :: held 1.524s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:41 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-1f556c7e-4ae0-4a10-83b6-98235a0044cf tempest-ProjectMemberTests-2128151930 None] Created reservations ['cfc6e1e0-b902-40ba-9a85-64040b1be437', '98f05b0d-3a3a-43d3-8e2c-fb40ecaf9ad5', '861e41fd-9faa-4b15-bc72-1aa07b13291f', '41247e25-f25f-4803-acd5-89ac96b782bd'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:12:41 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-1f556c7e-4ae0-4a10-83b6-98235a0044cf tempest-ProjectMemberTests-2128151930 None] Delete snapshot completed successfully. Sep 21 12:12:41 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-1f556c7e-4ae0-4a10-83b6-98235a0044cf tempest-ProjectMemberTests-2128151930 None] Lock "cinder-dff98c99-7c4d-4e68-9f10-35dd75d399b2-delete_snapshot" released by "delete_snapshot" :: held 1.683s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:41 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0286c588-499c-4518-8d67-ab0a0662fcc9 tempest-SnapshotDependencyTests-65646176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.1762b315-a665-49f1-9c5f-93f53451fc36 1G" returned: 0 in 0.458s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0286c588-499c-4518-8d67-ab0a0662fcc9 tempest-SnapshotDependencyTests-65646176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-375f7043-a02e-46d3-b79d-1587a9965521 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.1762b315-a665-49f1-9c5f-93f53451fc36 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:41 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-375f7043-a02e-46d3-b79d-1587a9965521 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.1762b315-a665-49f1-9c5f-93f53451fc36 Sep 21 12:12:41 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:41 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0286c588-499c-4518-8d67-ab0a0662fcc9 tempest-SnapshotDependencyTests-65646176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-375f7043-a02e-46d3-b79d-1587a9965521 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.1762b315-a665-49f1-9c5f-93f53451fc36" returned: 0 in 0.293s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:41 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-0286c588-499c-4518-8d67-ab0a0662fcc9 tempest-SnapshotDependencyTests-65646176 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.1762b315-a665-49f1-9c5f-93f53451fc36 is being set with open permissions: ugo+rw Sep 21 12:12:41 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0286c588-499c-4518-8d67-ab0a0662fcc9 tempest-SnapshotDependencyTests-65646176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.1762b315-a665-49f1-9c5f-93f53451fc36 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:41 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.1762b315-a665-49f1-9c5f-93f53451fc36 Sep 21 12:12:41 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3c248677-abcd-4d05-8d47-2d5d9fc6ab85 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3c248677-abcd-4d05-8d47-2d5d9fc6ab85 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3c248677-abcd-4d05-8d47-2d5d9fc6ab85 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-quobyte-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3c248677-abcd-4d05-8d47-2d5d9fc6ab85 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda" acquired by "delete_volume" :: waited 0.018s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:42 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0286c588-499c-4518-8d67-ab0a0662fcc9 tempest-SnapshotDependencyTests-65646176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.1762b315-a665-49f1-9c5f-93f53451fc36" returned: 0 in 0.279s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:42 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[462d4df8-0098-4708-8fa1-0df1397a778d]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3c248677-abcd-4d05-8d47-2d5d9fc6ab85 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0286c588-499c-4518-8d67-ab0a0662fcc9 tempest-SnapshotDependencyTests-65646176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:42 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.info Sep 21 12:12:42 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:42 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda Sep 21 12:12:42 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:42 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0286c588-499c-4518-8d67-ab0a0662fcc9 tempest-SnapshotDependencyTests-65646176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.info" returned: 0 in 0.263s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:42 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-0286c588-499c-4518-8d67-ab0a0662fcc9 tempest-SnapshotDependencyTests-65646176 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.info is being set with open permissions: ugo+rw Sep 21 12:12:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0286c588-499c-4518-8d67-ab0a0662fcc9 tempest-SnapshotDependencyTests-65646176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:42 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.info Sep 21 12:12:42 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:42 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3c248677-abcd-4d05-8d47-2d5d9fc6ab85 tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda" returned: 0 in 0.405s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3c248677-abcd-4d05-8d47-2d5d9fc6ab85 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:42 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda Sep 21 12:12:42 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:42 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0286c588-499c-4518-8d67-ab0a0662fcc9 tempest-SnapshotDependencyTests-65646176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.info" returned: 0 in 0.260s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0286c588-499c-4518-8d67-ab0a0662fcc9 tempest-SnapshotDependencyTests-65646176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.049s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:42 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-0286c588-499c-4518-8d67-ab0a0662fcc9 tempest-SnapshotDependencyTests-65646176 None] Create snapshot completed successfully Sep 21 12:12:42 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3c248677-abcd-4d05-8d47-2d5d9fc6ab85 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda" returned: 0 in 0.274s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:42 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3c248677-abcd-4d05-8d47-2d5d9fc6ab85 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda" released by "delete_volume" :: held 0.758s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:42 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-3c248677-abcd-4d05-8d47-2d5d9fc6ab85 tempest-ProjectMemberTests-2128151930 None] Created reservations ['2b381aa3-b667-402e-98df-f0f561a4079f', 'baffa2d7-56b2-4ffb-afe3-da933f3d1629', '1c6d1776-7fda-496a-bf60-3caad9b92bec', '35157eb7-f8b2-4895-b094-2daeb69d0542'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:12:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3c248677-abcd-4d05-8d47-2d5d9fc6ab85 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3c248677-abcd-4d05-8d47-2d5d9fc6ab85 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:42 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3c248677-abcd-4d05-8d47-2d5d9fc6ab85 tempest-ProjectMemberTests-2128151930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:12:42 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-3c248677-abcd-4d05-8d47-2d5d9fc6ab85 tempest-ProjectMemberTests-2128151930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:12:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-3c248677-abcd-4d05-8d47-2d5d9fc6ab85 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:42 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3c248677-abcd-4d05-8d47-2d5d9fc6ab85 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:42 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:12:42 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:43 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-3c248677-abcd-4d05-8d47-2d5d9fc6ab85 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.241s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:43 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-3c248677-abcd-4d05-8d47-2d5d9fc6ab85 tempest-ProjectMemberTests-2128151930 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:12:43 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-3c248677-abcd-4d05-8d47-2d5d9fc6ab85 tempest-ProjectMemberTests-2128151930 None] Deleted volume successfully. Sep 21 12:12:43 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-3c248677-abcd-4d05-8d47-2d5d9fc6ab85 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-1f417c0c-89ae-46cc-8aac-de7a4c2a0dda-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:43 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:12:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Flow 'volume_create_manager' (e7784b58-0be9-4164-bb5f-72ee0d9adcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:12:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f86280af-31ca-4825-b1c8-e15bd8fae97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f86280af-31ca-4825-b1c8-e15bd8fae97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-167116417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41993c48-c207-42fa-8d1b-36dcceeff665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3ab3953afc4ba588a5a6758fef10a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:12:44Z,use_quota=True,user_id='8da888e194c942a6896757d64cd62196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf20af2-28bc-4a92-b088-4ba3740d2329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf20af2-28bc-4a92-b088-4ba3740d2329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a667bf56-1356-429b-b6e0-bf3a0a08154c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a667bf56-1356-429b-b6e0-bf3a0a08154c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41993c48-c207-42fa-8d1b-36dcceeff665', 'volume_name': 'volume-41993c48-c207-42fa-8d1b-36dcceeff665', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b6f96bc-2a11-47ac-8e92-8c088b0c59dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b6f96bc-2a11-47ac-8e92-8c088b0c59dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:43 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2237b08-8570-44a0-9a03-b5bab4cd4020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:43 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Volume 41993c48-c207-42fa-8d1b-36dcceeff665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41993c48-c207-42fa-8d1b-36dcceeff665', 'volume_size': 1} Sep 21 12:12:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:43 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:12:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-167116417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41993c48-c207-42fa-8d1b-36dcceeff665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3ab3953afc4ba588a5a6758fef10a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:12:44Z,use_quota=True,user_id='8da888e194c942a6896757d64cd62196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:12:43 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Creating volume 41993c48-c207-42fa-8d1b-36dcceeff665 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:12:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:43 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:12:43 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:12:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:43 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:12:43 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:12:43 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:43 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665 1073741824 Sep 21 12:12:43 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:44 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665 1073741824" returned: 0 in 0.473s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:44 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665 Sep 21 12:12:44 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Flow 'volume_create_manager' (a715e15d-84b9-4574-bcb2-52ff7890bfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb554149-a6f9-4c3f-a97d-d9813e479ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb554149-a6f9-4c3f-a97d-d9813e479ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2d2d213-8cee-430f-ac27-4b19bd063e09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f26d0e431abf43b5b1f1b72faf088e8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1762b315-a665-49f1-9c5f-93f53451fc36,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:12:44Z,use_quota=True,user_id='be9108cc572d4c68b94b103e38953dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad78a07-8787-4fe5-a689-0b3eb31e636b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad78a07-8787-4fe5-a689-0b3eb31e636b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807a7271-df3f-41f2-b008-8d6e1ff039c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (807a7271-df3f-41f2-b008-8d6e1ff039c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e2d2d213-8cee-430f-ac27-4b19bd063e09', 'volume_name': 'volume-e2d2d213-8cee-430f-ac27-4b19bd063e09', 'volume_size': 1, 'snapshot_id': '1762b315-a665-49f1-9c5f-93f53451fc36'}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2cfabc3-e8dd-47c8-8083-029d9a86a969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2cfabc3-e8dd-47c8-8083-029d9a86a969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81c510a2-4d8b-4919-ac05-18169bdad9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:44 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Volume e2d2d213-8cee-430f-ac27-4b19bd063e09: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e2d2d213-8cee-430f-ac27-4b19bd063e09', 'volume_size': 1, 'snapshot_id': '1762b315-a665-49f1-9c5f-93f53451fc36'} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:44 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665" returned: 0 in 0.293s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Acquiring lock "cinder-quobyte-1762b315-a665-49f1-9c5f-93f53451fc36-e2d2d213-8cee-430f-ac27-4b19bd063e09" by "_create_volume_from_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Lock "cinder-quobyte-1762b315-a665-49f1-9c5f-93f53451fc36-e2d2d213-8cee-430f-ac27-4b19bd063e09" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Creating volume e2d2d213-8cee-430f-ac27-4b19bd063e09 from snapshot 1762b315-a665-49f1-9c5f-93f53451fc36 {{(pid=86366) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Acquiring lock "cinder-quobyte-e2d2d213-8cee-430f-ac27-4b19bd063e09" by "_copy_volume_from_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2237b08-8570-44a0-9a03-b5bab4cd4020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41993c48-c207-42fa-8d1b-36dcceeff665', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76848827-0a31-46cb-942c-408fa8dfbcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Lock "cinder-quobyte-e2d2d213-8cee-430f-ac27-4b19bd063e09" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] snapshot: 1762b315-a665-49f1-9c5f-93f53451fc36, volume: e2d2d213-8cee-430f-ac27-4b19bd063e09, {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 21 12:12:44 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Volume volume-41993c48-c207-42fa-8d1b-36dcceeff665 (41993c48-c207-42fa-8d1b-36dcceeff665): created successfully Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76848827-0a31-46cb-942c-408fa8dfbcbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Flow 'volume_create_manager' (e7784b58-0be9-4164-bb5f-72ee0d9adcb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:44 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-9f06c810-635f-4859-a17c-bbd4ca8daba7 tempest-ProjectMemberTests-2128151930 None] Created volume successfully. Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[927534bf-d354-40ab-8235-f0cc5510ebcf]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:44 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.1762b315-a665-49f1-9c5f-93f53451fc36 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:44 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.1762b315-a665-49f1-9c5f-93f53451fc36 Sep 21 12:12:44 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:45 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.1762b315-a665-49f1-9c5f-93f53451fc36" returned: 0 in 0.397s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-375f7043-a02e-46d3-b79d-1587a9965521(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:12:45 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2610cd9-3502-4311-af06-fab096b54603]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:45 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521 Sep 21 12:12:45 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:45 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521" returned: 0 in 0.395s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521 {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 21 12:12:45 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Creating direct copy from snapshot {{(pid=86366) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 21 12:12:45 devstack cinder-volume[86366]: DEBUG cinder.utils [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Path /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e2d2d213-8cee-430f-ac27-4b19bd063e09 not found in is_blk_device check {{(pid=86366) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 21 12:12:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e2d2d213-8cee-430f-ac27-4b19bd063e09 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:45 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e2d2d213-8cee-430f-ac27-4b19bd063e09 Sep 21 12:12:45 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:45 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-92df97f7-7de8-4577-82ba-d7d6423c4bf9 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:51 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e2d2d213-8cee-430f-ac27-4b19bd063e09" returned: 0 in 6.090s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:51 devstack cinder-volume[86366]: DEBUG cinder.image.image_utils [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Image conversion details: src /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521, size 1024.00 MB, duration 6.09 sec, destination /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e2d2d213-8cee-430f-ac27-4b19bd063e09 {{(pid=86366) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 21 12:12:51 devstack cinder-volume[86366]: INFO cinder.image.image_utils [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Converted 1024.00 MB image at 168.13 MB/s Sep 21 12:12:51 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e2d2d213-8cee-430f-ac27-4b19bd063e09 is being set with open permissions: ugo+rw Sep 21 12:12:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e2d2d213-8cee-430f-ac27-4b19bd063e09 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:51 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e2d2d213-8cee-430f-ac27-4b19bd063e09 Sep 21 12:12:51 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:51 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e2d2d213-8cee-430f-ac27-4b19bd063e09" returned: 0 in 0.235s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:51 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Lock "cinder-quobyte-e2d2d213-8cee-430f-ac27-4b19bd063e09" released by "_copy_volume_from_snapshot" :: held 7.221s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:51 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Lock "cinder-quobyte-1762b315-a665-49f1-9c5f-93f53451fc36-e2d2d213-8cee-430f-ac27-4b19bd063e09" released by "_create_volume_from_snapshot" :: held 7.298s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.319s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-92df97f7-7de8-4577-82ba-d7d6423c4bf9 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.945s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:51 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-92df97f7-7de8-4577-82ba-d7d6423c4bf9 tempest-ProjectMemberTests-2128151930 None] Creating offline snapshot 3d6514de-2469-4f7b-9a8f-75d105c0478c of volume 41993c48-c207-42fa-8d1b-36dcceeff665 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:12:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81c510a2-4d8b-4919-ac05-18169bdad9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2d2d213-8cee-430f-ac27-4b19bd063e09', 'volume_size': 1, 'snapshot_id': '1762b315-a665-49f1-9c5f-93f53451fc36'}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b37649d-a585-4843-99ad-05192696d897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:51 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[340623c9-2f60-486e-8676-e82671dea694]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:51 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-92df97f7-7de8-4577-82ba-d7d6423c4bf9 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:51 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Volume volume-e2d2d213-8cee-430f-ac27-4b19bd063e09 (e2d2d213-8cee-430f-ac27-4b19bd063e09): created successfully Sep 21 12:12:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b37649d-a585-4843-99ad-05192696d897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:51 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Flow 'volume_create_manager' (a715e15d-84b9-4574-bcb2-52ff7890bfaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:12:52 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-9013a8a9-4ef2-4336-b2ba-8f330573d07e tempest-SnapshotDependencyTests-65646176 None] Created volume successfully. Sep 21 12:12:52 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665 Sep 21 12:12:52 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:52 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-92df97f7-7de8-4577-82ba-d7d6423c4bf9 tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665" returned: 0 in 0.377s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-92df97f7-7de8-4577-82ba-d7d6423c4bf9 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665.3d6514de-2469-4f7b-9a8f-75d105c0478c 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:52 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665.3d6514de-2469-4f7b-9a8f-75d105c0478c 1G Sep 21 12:12:52 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:52 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-92df97f7-7de8-4577-82ba-d7d6423c4bf9 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665.3d6514de-2469-4f7b-9a8f-75d105c0478c 1G" returned: 0 in 0.398s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:52 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-92df97f7-7de8-4577-82ba-d7d6423c4bf9 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41993c48-c207-42fa-8d1b-36dcceeff665 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665.3d6514de-2469-4f7b-9a8f-75d105c0478c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:52 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41993c48-c207-42fa-8d1b-36dcceeff665 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665.3d6514de-2469-4f7b-9a8f-75d105c0478c Sep 21 12:12:52 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:53 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-92df97f7-7de8-4577-82ba-d7d6423c4bf9 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41993c48-c207-42fa-8d1b-36dcceeff665 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665.3d6514de-2469-4f7b-9a8f-75d105c0478c" returned: 0 in 0.312s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:53 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-92df97f7-7de8-4577-82ba-d7d6423c4bf9 tempest-ProjectMemberTests-2128151930 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665.3d6514de-2469-4f7b-9a8f-75d105c0478c is being set with open permissions: ugo+rw Sep 21 12:12:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-92df97f7-7de8-4577-82ba-d7d6423c4bf9 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665.3d6514de-2469-4f7b-9a8f-75d105c0478c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:53 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665.3d6514de-2469-4f7b-9a8f-75d105c0478c Sep 21 12:12:53 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-efd514be-17f2-4b30-9537-1e61d9cf0e51 tempest-SnapshotDependencyTests-65646176 None] Acquiring lock "cinder-1762b315-a665-49f1-9c5f-93f53451fc36-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-efd514be-17f2-4b30-9537-1e61d9cf0e51 tempest-SnapshotDependencyTests-65646176 None] Lock "cinder-1762b315-a665-49f1-9c5f-93f53451fc36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-efd514be-17f2-4b30-9537-1e61d9cf0e51 tempest-SnapshotDependencyTests-65646176 None] Acquiring lock "cinder-quobyte-375f7043-a02e-46d3-b79d-1587a9965521" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-efd514be-17f2-4b30-9537-1e61d9cf0e51 tempest-SnapshotDependencyTests-65646176 None] Lock "cinder-quobyte-375f7043-a02e-46d3-b79d-1587a9965521" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-efd514be-17f2-4b30-9537-1e61d9cf0e51 tempest-SnapshotDependencyTests-65646176 None] Acquiring lock "cinder-quobyte-1762b315-a665-49f1-9c5f-93f53451fc36" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:53 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-efd514be-17f2-4b30-9537-1e61d9cf0e51 tempest-SnapshotDependencyTests-65646176 None] Lock "cinder-quobyte-1762b315-a665-49f1-9c5f-93f53451fc36" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:53 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-efd514be-17f2-4b30-9537-1e61d9cf0e51 tempest-SnapshotDependencyTests-65646176 None] Deleting offline snapshot 1762b315-a665-49f1-9c5f-93f53451fc36 of volume 375f7043-a02e-46d3-b79d-1587a9965521 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:12:53 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-efd514be-17f2-4b30-9537-1e61d9cf0e51 tempest-SnapshotDependencyTests-65646176 None] snapshot_file for this snap is: volume-375f7043-a02e-46d3-b79d-1587a9965521.1762b315-a665-49f1-9c5f-93f53451fc36 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:12:53 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cefaf1-69cc-4d56-ad53-ef8695fc08cd]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-efd514be-17f2-4b30-9537-1e61d9cf0e51 tempest-SnapshotDependencyTests-65646176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.1762b315-a665-49f1-9c5f-93f53451fc36 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:53 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-92df97f7-7de8-4577-82ba-d7d6423c4bf9 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665.3d6514de-2469-4f7b-9a8f-75d105c0478c" returned: 0 in 0.269s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-92df97f7-7de8-4577-82ba-d7d6423c4bf9 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:53 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.1762b315-a665-49f1-9c5f-93f53451fc36 Sep 21 12:12:53 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:53 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665.info Sep 21 12:12:53 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:53 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-92df97f7-7de8-4577-82ba-d7d6423c4bf9 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665.info" returned: 0 in 0.268s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:53 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-92df97f7-7de8-4577-82ba-d7d6423c4bf9 tempest-ProjectMemberTests-2128151930 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665.info is being set with open permissions: ugo+rw Sep 21 12:12:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-92df97f7-7de8-4577-82ba-d7d6423c4bf9 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:53 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-efd514be-17f2-4b30-9537-1e61d9cf0e51 tempest-SnapshotDependencyTests-65646176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.1762b315-a665-49f1-9c5f-93f53451fc36" returned: 0 in 0.386s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:53 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-efd514be-17f2-4b30-9537-1e61d9cf0e51 tempest-SnapshotDependencyTests-65646176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-375f7043-a02e-46d3-b79d-1587a9965521(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:12:53 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665.info Sep 21 12:12:53 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:53 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7a029f-1575-4504-98a3-1b0b76ca75cc]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-efd514be-17f2-4b30-9537-1e61d9cf0e51 tempest-SnapshotDependencyTests-65646176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:53 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521 Sep 21 12:12:53 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:53 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-92df97f7-7de8-4577-82ba-d7d6423c4bf9 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665.info" returned: 0 in 0.251s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:53 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-92df97f7-7de8-4577-82ba-d7d6423c4bf9 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.990s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:53 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-92df97f7-7de8-4577-82ba-d7d6423c4bf9 tempest-ProjectMemberTests-2128151930 None] Create snapshot completed successfully Sep 21 12:12:54 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-efd514be-17f2-4b30-9537-1e61d9cf0e51 tempest-SnapshotDependencyTests-65646176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521" returned: 0 in 0.550s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-efd514be-17f2-4b30-9537-1e61d9cf0e51 tempest-SnapshotDependencyTests-65646176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.1762b315-a665-49f1-9c5f-93f53451fc36 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:54 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.1762b315-a665-49f1-9c5f-93f53451fc36 Sep 21 12:12:54 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7a309aab-d5ef-4ab0-a5eb-2fd1c002a835 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-3d6514de-2469-4f7b-9a8f-75d105c0478c-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7a309aab-d5ef-4ab0-a5eb-2fd1c002a835 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-3d6514de-2469-4f7b-9a8f-75d105c0478c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7a309aab-d5ef-4ab0-a5eb-2fd1c002a835 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-quobyte-41993c48-c207-42fa-8d1b-36dcceeff665" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7a309aab-d5ef-4ab0-a5eb-2fd1c002a835 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-41993c48-c207-42fa-8d1b-36dcceeff665" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7a309aab-d5ef-4ab0-a5eb-2fd1c002a835 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-quobyte-3d6514de-2469-4f7b-9a8f-75d105c0478c" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7a309aab-d5ef-4ab0-a5eb-2fd1c002a835 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-3d6514de-2469-4f7b-9a8f-75d105c0478c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:54 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-7a309aab-d5ef-4ab0-a5eb-2fd1c002a835 tempest-ProjectMemberTests-2128151930 None] Deleting offline snapshot 3d6514de-2469-4f7b-9a8f-75d105c0478c of volume 41993c48-c207-42fa-8d1b-36dcceeff665 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:12:54 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-7a309aab-d5ef-4ab0-a5eb-2fd1c002a835 tempest-ProjectMemberTests-2128151930 None] snapshot_file for this snap is: volume-41993c48-c207-42fa-8d1b-36dcceeff665.3d6514de-2469-4f7b-9a8f-75d105c0478c {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:12:54 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d79cc19-94bf-4d45-b37b-146dd98e4aec]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7a309aab-d5ef-4ab0-a5eb-2fd1c002a835 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665.3d6514de-2469-4f7b-9a8f-75d105c0478c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:54 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665.3d6514de-2469-4f7b-9a8f-75d105c0478c Sep 21 12:12:54 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:54 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-efd514be-17f2-4b30-9537-1e61d9cf0e51 tempest-SnapshotDependencyTests-65646176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.1762b315-a665-49f1-9c5f-93f53451fc36" returned: 0 in 0.372s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-efd514be-17f2-4b30-9537-1e61d9cf0e51 tempest-SnapshotDependencyTests-65646176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.1762b315-a665-49f1-9c5f-93f53451fc36 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:54 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.1762b315-a665-49f1-9c5f-93f53451fc36 Sep 21 12:12:54 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:54 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7a309aab-d5ef-4ab0-a5eb-2fd1c002a835 tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665.3d6514de-2469-4f7b-9a8f-75d105c0478c" returned: 0 in 0.389s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:54 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-7a309aab-d5ef-4ab0-a5eb-2fd1c002a835 tempest-ProjectMemberTests-2128151930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41993c48-c207-42fa-8d1b-36dcceeff665(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:12:54 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbbcbf5-4d4e-449e-b857-3fa717c7d87c]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7a309aab-d5ef-4ab0-a5eb-2fd1c002a835 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:54 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:54 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-efd514be-17f2-4b30-9537-1e61d9cf0e51 tempest-SnapshotDependencyTests-65646176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521.1762b315-a665-49f1-9c5f-93f53451fc36" returned: 0 in 0.272s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-efd514be-17f2-4b30-9537-1e61d9cf0e51 tempest-SnapshotDependencyTests-65646176 None] Lock "cinder-quobyte-1762b315-a665-49f1-9c5f-93f53451fc36" released by "_delete_snapshot" :: held 1.725s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:54 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-efd514be-17f2-4b30-9537-1e61d9cf0e51 tempest-SnapshotDependencyTests-65646176 None] Lock "cinder-quobyte-375f7043-a02e-46d3-b79d-1587a9965521" released by "delete_snapshot" :: held 1.748s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:54 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665 Sep 21 12:12:54 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:54 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-efd514be-17f2-4b30-9537-1e61d9cf0e51 tempest-SnapshotDependencyTests-65646176 None] Created reservations ['22735020-fd22-4b6d-9973-216fcd5b819e', 'c770bdb3-e017-4395-9f6a-2ca1f83522dd', '8ea12da2-3274-454c-a9bf-33687eedb555', '7e957079-a4d5-419c-b01d-9b53cb555a0d'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:12:55 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-efd514be-17f2-4b30-9537-1e61d9cf0e51 tempest-SnapshotDependencyTests-65646176 None] Delete snapshot completed successfully. Sep 21 12:12:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-efd514be-17f2-4b30-9537-1e61d9cf0e51 tempest-SnapshotDependencyTests-65646176 None] Lock "cinder-1762b315-a665-49f1-9c5f-93f53451fc36-delete_snapshot" released by "delete_snapshot" :: held 1.899s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:55 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7a309aab-d5ef-4ab0-a5eb-2fd1c002a835 tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665" returned: 0 in 0.389s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7a309aab-d5ef-4ab0-a5eb-2fd1c002a835 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665.3d6514de-2469-4f7b-9a8f-75d105c0478c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:55 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665.3d6514de-2469-4f7b-9a8f-75d105c0478c Sep 21 12:12:55 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-188bd0de-db9b-4529-a8b4-5cefbf70673a tempest-SnapshotDependencyTests-65646176 None] Acquiring lock "cinder-375f7043-a02e-46d3-b79d-1587a9965521-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-188bd0de-db9b-4529-a8b4-5cefbf70673a tempest-SnapshotDependencyTests-65646176 None] Lock "cinder-375f7043-a02e-46d3-b79d-1587a9965521-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-188bd0de-db9b-4529-a8b4-5cefbf70673a tempest-SnapshotDependencyTests-65646176 None] Acquiring lock "cinder-quobyte-375f7043-a02e-46d3-b79d-1587a9965521" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-188bd0de-db9b-4529-a8b4-5cefbf70673a tempest-SnapshotDependencyTests-65646176 None] Lock "cinder-quobyte-375f7043-a02e-46d3-b79d-1587a9965521" acquired by "delete_volume" :: waited 0.025s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:55 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[975b9cc4-8263-4d25-9389-bbcfa82bccc3]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-188bd0de-db9b-4529-a8b4-5cefbf70673a tempest-SnapshotDependencyTests-65646176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:55 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521 Sep 21 12:12:55 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:55 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7a309aab-d5ef-4ab0-a5eb-2fd1c002a835 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665.3d6514de-2469-4f7b-9a8f-75d105c0478c" returned: 0 in 0.375s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7a309aab-d5ef-4ab0-a5eb-2fd1c002a835 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665.3d6514de-2469-4f7b-9a8f-75d105c0478c {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:55 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665.3d6514de-2469-4f7b-9a8f-75d105c0478c Sep 21 12:12:55 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:55 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-7a309aab-d5ef-4ab0-a5eb-2fd1c002a835 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665.3d6514de-2469-4f7b-9a8f-75d105c0478c" returned: 0 in 0.245s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:55 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-188bd0de-db9b-4529-a8b4-5cefbf70673a tempest-SnapshotDependencyTests-65646176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521" returned: 0 in 0.428s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:55 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-188bd0de-db9b-4529-a8b4-5cefbf70673a tempest-SnapshotDependencyTests-65646176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7a309aab-d5ef-4ab0-a5eb-2fd1c002a835 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-3d6514de-2469-4f7b-9a8f-75d105c0478c" released by "_delete_snapshot" :: held 1.520s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:55 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7a309aab-d5ef-4ab0-a5eb-2fd1c002a835 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-41993c48-c207-42fa-8d1b-36dcceeff665" released by "delete_snapshot" :: held 1.547s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:55 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521 Sep 21 12:12:55 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:55 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-7a309aab-d5ef-4ab0-a5eb-2fd1c002a835 tempest-ProjectMemberTests-2128151930 None] Created reservations ['a34d8c60-a5ed-410e-814d-2b6386f71bb3', '1983666a-f2ff-4e4b-92a7-3f47b1b99e4a', 'c4b9ffc0-f18b-4498-9cf0-0feca6b76c92', 'c232b0fd-d3c0-4359-90e3-6071d2e54f17'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:12:56 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-7a309aab-d5ef-4ab0-a5eb-2fd1c002a835 tempest-ProjectMemberTests-2128151930 None] Delete snapshot completed successfully. Sep 21 12:12:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-7a309aab-d5ef-4ab0-a5eb-2fd1c002a835 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-3d6514de-2469-4f7b-9a8f-75d105c0478c-delete_snapshot" released by "delete_snapshot" :: held 1.700s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:56 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-188bd0de-db9b-4529-a8b4-5cefbf70673a tempest-SnapshotDependencyTests-65646176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-375f7043-a02e-46d3-b79d-1587a9965521" returned: 0 in 0.283s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-188bd0de-db9b-4529-a8b4-5cefbf70673a tempest-SnapshotDependencyTests-65646176 None] Lock "cinder-quobyte-375f7043-a02e-46d3-b79d-1587a9965521" released by "delete_volume" :: held 0.783s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:56 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-188bd0de-db9b-4529-a8b4-5cefbf70673a tempest-SnapshotDependencyTests-65646176 None] Created reservations ['cc5b836d-a752-4811-af26-9dc31c545c03', '21171316-0015-4aff-929a-b961fdf26eaf', '814cb435-2ba1-46f5-aeba-87d02c1af222', 'a16744dd-4c53-47e6-bc52-945f8569064f'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:12:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-188bd0de-db9b-4529-a8b4-5cefbf70673a tempest-SnapshotDependencyTests-65646176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-188bd0de-db9b-4529-a8b4-5cefbf70673a tempest-SnapshotDependencyTests-65646176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-188bd0de-db9b-4529-a8b4-5cefbf70673a tempest-SnapshotDependencyTests-65646176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:12:56 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-188bd0de-db9b-4529-a8b4-5cefbf70673a tempest-SnapshotDependencyTests-65646176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:12:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-188bd0de-db9b-4529-a8b4-5cefbf70673a tempest-SnapshotDependencyTests-65646176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-188bd0de-db9b-4529-a8b4-5cefbf70673a tempest-SnapshotDependencyTests-65646176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:56 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:12:56 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-76062983-fbb2-432b-b30f-2e7f80e4820f tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-41993c48-c207-42fa-8d1b-36dcceeff665-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-aa5c313d-b04b-4fd4-8f82-9db786ff8a55 tempest-SnapshotDependencyTests-65646176 None] Acquiring lock "cinder-e2d2d213-8cee-430f-ac27-4b19bd063e09-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-76062983-fbb2-432b-b30f-2e7f80e4820f tempest-ProjectMemberTests-2128151930 None] Lock "cinder-41993c48-c207-42fa-8d1b-36dcceeff665-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:56 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-aa5c313d-b04b-4fd4-8f82-9db786ff8a55 tempest-SnapshotDependencyTests-65646176 None] Lock "cinder-e2d2d213-8cee-430f-ac27-4b19bd063e09-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-188bd0de-db9b-4529-a8b4-5cefbf70673a tempest-SnapshotDependencyTests-65646176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.310s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:56 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-188bd0de-db9b-4529-a8b4-5cefbf70673a tempest-SnapshotDependencyTests-65646176 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:12:56 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-188bd0de-db9b-4529-a8b4-5cefbf70673a tempest-SnapshotDependencyTests-65646176 None] Deleted volume successfully. Sep 21 12:12:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-76062983-fbb2-432b-b30f-2e7f80e4820f tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-quobyte-41993c48-c207-42fa-8d1b-36dcceeff665" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-188bd0de-db9b-4529-a8b4-5cefbf70673a tempest-SnapshotDependencyTests-65646176 None] Lock "cinder-375f7043-a02e-46d3-b79d-1587a9965521-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-aa5c313d-b04b-4fd4-8f82-9db786ff8a55 tempest-SnapshotDependencyTests-65646176 None] Acquiring lock "cinder-quobyte-e2d2d213-8cee-430f-ac27-4b19bd063e09" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:12:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-76062983-fbb2-432b-b30f-2e7f80e4820f tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-41993c48-c207-42fa-8d1b-36dcceeff665" acquired by "delete_volume" :: waited 0.026s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:56 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-aa5c313d-b04b-4fd4-8f82-9db786ff8a55 tempest-SnapshotDependencyTests-65646176 None] Lock "cinder-quobyte-e2d2d213-8cee-430f-ac27-4b19bd063e09" acquired by "delete_volume" :: waited 0.044s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:12:56 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d76d2d-e7d0-4410-bca8-3f09dbda9896]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-76062983-fbb2-432b-b30f-2e7f80e4820f tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:56 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[79df7665-e118-4ee3-9d7c-55b6deb075b6]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:12:56 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-aa5c313d-b04b-4fd4-8f82-9db786ff8a55 tempest-SnapshotDependencyTests-65646176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e2d2d213-8cee-430f-ac27-4b19bd063e09 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:56 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e2d2d213-8cee-430f-ac27-4b19bd063e09 Sep 21 12:12:56 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665 Sep 21 12:12:56 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:56 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:57 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-aa5c313d-b04b-4fd4-8f82-9db786ff8a55 tempest-SnapshotDependencyTests-65646176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e2d2d213-8cee-430f-ac27-4b19bd063e09" returned: 0 in 0.390s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-aa5c313d-b04b-4fd4-8f82-9db786ff8a55 tempest-SnapshotDependencyTests-65646176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e2d2d213-8cee-430f-ac27-4b19bd063e09 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:57 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e2d2d213-8cee-430f-ac27-4b19bd063e09 Sep 21 12:12:57 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:57 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-76062983-fbb2-432b-b30f-2e7f80e4820f tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665" returned: 0 in 0.441s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-76062983-fbb2-432b-b30f-2e7f80e4820f tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:57 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665 Sep 21 12:12:57 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:57 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-aa5c313d-b04b-4fd4-8f82-9db786ff8a55 tempest-SnapshotDependencyTests-65646176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-e2d2d213-8cee-430f-ac27-4b19bd063e09" returned: 0 in 0.270s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:57 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-aa5c313d-b04b-4fd4-8f82-9db786ff8a55 tempest-SnapshotDependencyTests-65646176 None] Lock "cinder-quobyte-e2d2d213-8cee-430f-ac27-4b19bd063e09" released by "delete_volume" :: held 0.709s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:57 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-76062983-fbb2-432b-b30f-2e7f80e4820f tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-41993c48-c207-42fa-8d1b-36dcceeff665" returned: 0 in 0.270s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:57 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-76062983-fbb2-432b-b30f-2e7f80e4820f tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-41993c48-c207-42fa-8d1b-36dcceeff665" released by "delete_volume" :: held 0.785s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:57 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-aa5c313d-b04b-4fd4-8f82-9db786ff8a55 tempest-SnapshotDependencyTests-65646176 None] Created reservations ['971053a3-8a9e-426d-8a39-bdd83a84c712', 'ec7f15c1-ce6e-480c-9891-cc87eb476aa0', '094127d0-4665-46ca-ac49-0add6f250082', '0281cb2b-7e7a-4fa8-9397-d6f9e42ad755'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:12:57 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-76062983-fbb2-432b-b30f-2e7f80e4820f tempest-ProjectMemberTests-2128151930 None] Created reservations ['f6c6729f-00c1-42cf-b017-a78d4ee03743', 'dfb99049-6fd4-4319-a6e8-776bc699874a', '94004b28-33e0-40c5-9547-2a4b1b8deae6', 'aeb835f7-8a2c-4811-9eaa-79bc32abeea8'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:12:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-76062983-fbb2-432b-b30f-2e7f80e4820f tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-76062983-fbb2-432b-b30f-2e7f80e4820f tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-76062983-fbb2-432b-b30f-2e7f80e4820f tempest-ProjectMemberTests-2128151930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:12:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-76062983-fbb2-432b-b30f-2e7f80e4820f tempest-ProjectMemberTests-2128151930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:12:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-76062983-fbb2-432b-b30f-2e7f80e4820f tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-76062983-fbb2-432b-b30f-2e7f80e4820f tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:57 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:12:57 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-aa5c313d-b04b-4fd4-8f82-9db786ff8a55 tempest-SnapshotDependencyTests-65646176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-aa5c313d-b04b-4fd4-8f82-9db786ff8a55 tempest-SnapshotDependencyTests-65646176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-aa5c313d-b04b-4fd4-8f82-9db786ff8a55 tempest-SnapshotDependencyTests-65646176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:12:57 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-aa5c313d-b04b-4fd4-8f82-9db786ff8a55 tempest-SnapshotDependencyTests-65646176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:12:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-aa5c313d-b04b-4fd4-8f82-9db786ff8a55 tempest-SnapshotDependencyTests-65646176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-aa5c313d-b04b-4fd4-8f82-9db786ff8a55 tempest-SnapshotDependencyTests-65646176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:57 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:12:57 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:57 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:57 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-76062983-fbb2-432b-b30f-2e7f80e4820f tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.306s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:57 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-76062983-fbb2-432b-b30f-2e7f80e4820f tempest-ProjectMemberTests-2128151930 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:12:57 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-76062983-fbb2-432b-b30f-2e7f80e4820f tempest-ProjectMemberTests-2128151930 None] Deleted volume successfully. Sep 21 12:12:58 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-76062983-fbb2-432b-b30f-2e7f80e4820f tempest-ProjectMemberTests-2128151930 None] Lock "cinder-41993c48-c207-42fa-8d1b-36dcceeff665-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:58 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-aa5c313d-b04b-4fd4-8f82-9db786ff8a55 tempest-SnapshotDependencyTests-65646176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.381s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:58 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-aa5c313d-b04b-4fd4-8f82-9db786ff8a55 tempest-SnapshotDependencyTests-65646176 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:12:58 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-aa5c313d-b04b-4fd4-8f82-9db786ff8a55 tempest-SnapshotDependencyTests-65646176 None] Deleted volume successfully. Sep 21 12:12:58 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-aa5c313d-b04b-4fd4-8f82-9db786ff8a55 tempest-SnapshotDependencyTests-65646176 None] Lock "cinder-e2d2d213-8cee-430f-ac27-4b19bd063e09-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:12:58 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:12:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Flow 'volume_create_manager' (744039e6-f8f5-4489-baea-6b98c10f3ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:12:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8659ef11-d323-4545-8038-470aaa7029c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8659ef11-d323-4545-8038-470aaa7029c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-430277024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90dff48a-d49f-4974-9ac6-a337ad528144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3ab3953afc4ba588a5a6758fef10a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:12:58Z,use_quota=True,user_id='8da888e194c942a6896757d64cd62196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a22e35-af88-4f95-89eb-06518c81856b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a22e35-af88-4f95-89eb-06518c81856b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94a48605-dc3d-432f-b5b8-a8c8110556b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94a48605-dc3d-432f-b5b8-a8c8110556b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90dff48a-d49f-4974-9ac6-a337ad528144', 'volume_name': 'volume-90dff48a-d49f-4974-9ac6-a337ad528144', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d30b2495-fff5-4c1e-92e0-39b5975da8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d30b2495-fff5-4c1e-92e0-39b5975da8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:58 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fac3f8c2-e9c7-41b2-97c0-38bf454967e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:58 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Volume 90dff48a-d49f-4974-9ac6-a337ad528144: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90dff48a-d49f-4974-9ac6-a337ad528144', 'volume_size': 1} Sep 21 12:12:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-430277024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90dff48a-d49f-4974-9ac6-a337ad528144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3ab3953afc4ba588a5a6758fef10a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:12:58Z,use_quota=True,user_id='8da888e194c942a6896757d64cd62196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:12:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Creating volume 90dff48a-d49f-4974-9ac6-a337ad528144 {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:12:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:12:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:12:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:12:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:12:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:58 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:12:58 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:12:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:58 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144 1073741824 Sep 21 12:12:58 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:58 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144 1073741824" returned: 0 in 0.505s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:58 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:12:58 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144 Sep 21 12:12:58 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:12:59 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Sep 21 12:12:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144" returned: 0 in 0.274s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:12:59 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:12:59 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:12:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fac3f8c2-e9c7-41b2-97c0-38bf454967e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90dff48a-d49f-4974-9ac6-a337ad528144', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8746cc7a-4943-4640-ab94-7ad8d0a429b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:12:59 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Volume volume-90dff48a-d49f-4974-9ac6-a337ad528144 (90dff48a-d49f-4974-9ac6-a337ad528144): created successfully Sep 21 12:12:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8746cc7a-4943-4640-ab94-7ad8d0a429b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:12:59 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Flow 'volume_create_manager' (744039e6-f8f5-4489-baea-6b98c10f3ea3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:12:59 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-0f2b62c0-70ec-4dcf-b00d-2936590a5b86 tempest-ProjectMemberTests-2128151930 None] Created volume successfully. Sep 21 12:13:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2af53add-8b56-45ce-84f0-d1d9453698cb tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:13:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2af53add-8b56-45ce-84f0-d1d9453698cb tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:13:00 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-2af53add-8b56-45ce-84f0-d1d9453698cb tempest-ProjectMemberTests-2128151930 None] Creating offline snapshot 75711fc9-5a29-4ad9-b987-d1a744719bb9 of volume 90dff48a-d49f-4974-9ac6-a337ad528144 {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:13:00 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8841c1-e8c4-4797-af27-17d1bd100d50]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:13:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2af53add-8b56-45ce-84f0-d1d9453698cb tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:00 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144 Sep 21 12:13:00 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:00 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2af53add-8b56-45ce-84f0-d1d9453698cb tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144" returned: 0 in 0.380s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:00 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2af53add-8b56-45ce-84f0-d1d9453698cb tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144.75711fc9-5a29-4ad9-b987-d1a744719bb9 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:00 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144.75711fc9-5a29-4ad9-b987-d1a744719bb9 1G Sep 21 12:13:00 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:01 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2af53add-8b56-45ce-84f0-d1d9453698cb tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144.75711fc9-5a29-4ad9-b987-d1a744719bb9 1G" returned: 0 in 0.386s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2af53add-8b56-45ce-84f0-d1d9453698cb tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90dff48a-d49f-4974-9ac6-a337ad528144 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144.75711fc9-5a29-4ad9-b987-d1a744719bb9 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:01 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90dff48a-d49f-4974-9ac6-a337ad528144 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144.75711fc9-5a29-4ad9-b987-d1a744719bb9 Sep 21 12:13:01 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:01 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2af53add-8b56-45ce-84f0-d1d9453698cb tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90dff48a-d49f-4974-9ac6-a337ad528144 -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144.75711fc9-5a29-4ad9-b987-d1a744719bb9" returned: 0 in 0.375s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:01 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-2af53add-8b56-45ce-84f0-d1d9453698cb tempest-ProjectMemberTests-2128151930 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144.75711fc9-5a29-4ad9-b987-d1a744719bb9 is being set with open permissions: ugo+rw Sep 21 12:13:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2af53add-8b56-45ce-84f0-d1d9453698cb tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144.75711fc9-5a29-4ad9-b987-d1a744719bb9 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:01 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144.75711fc9-5a29-4ad9-b987-d1a744719bb9 Sep 21 12:13:01 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:01 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:01 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2af53add-8b56-45ce-84f0-d1d9453698cb tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144.75711fc9-5a29-4ad9-b987-d1a744719bb9" returned: 0 in 0.253s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2af53add-8b56-45ce-84f0-d1d9453698cb tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:02 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144.info Sep 21 12:13:02 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:02 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2af53add-8b56-45ce-84f0-d1d9453698cb tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144.info" returned: 0 in 0.274s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:02 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-2af53add-8b56-45ce-84f0-d1d9453698cb tempest-ProjectMemberTests-2128151930 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144.info is being set with open permissions: ugo+rw Sep 21 12:13:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2af53add-8b56-45ce-84f0-d1d9453698cb tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:02 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144.info Sep 21 12:13:02 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:02 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2af53add-8b56-45ce-84f0-d1d9453698cb tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144.info" returned: 0 in 0.319s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:02 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-2af53add-8b56-45ce-84f0-d1d9453698cb tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.093s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:13:02 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-2af53add-8b56-45ce-84f0-d1d9453698cb tempest-ProjectMemberTests-2128151930 None] Create snapshot completed successfully Sep 21 12:13:03 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 12:13:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:13:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:13:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:13:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:13:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:13:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:03 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e5cc34a3-b673-4344-81ed-09f760836a91 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-75711fc9-5a29-4ad9-b987-d1a744719bb9-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:13:03 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:13:03 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:03 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e5cc34a3-b673-4344-81ed-09f760836a91 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-75711fc9-5a29-4ad9-b987-d1a744719bb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:13:03 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e5cc34a3-b673-4344-81ed-09f760836a91 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-quobyte-90dff48a-d49f-4974-9ac6-a337ad528144" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:13:03 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e5cc34a3-b673-4344-81ed-09f760836a91 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-90dff48a-d49f-4974-9ac6-a337ad528144" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:13:03 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e5cc34a3-b673-4344-81ed-09f760836a91 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-quobyte-75711fc9-5a29-4ad9-b987-d1a744719bb9" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:13:03 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e5cc34a3-b673-4344-81ed-09f760836a91 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-75711fc9-5a29-4ad9-b987-d1a744719bb9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:13:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-e5cc34a3-b673-4344-81ed-09f760836a91 tempest-ProjectMemberTests-2128151930 None] Deleting offline snapshot 75711fc9-5a29-4ad9-b987-d1a744719bb9 of volume 90dff48a-d49f-4974-9ac6-a337ad528144 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:13:03 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-e5cc34a3-b673-4344-81ed-09f760836a91 tempest-ProjectMemberTests-2128151930 None] snapshot_file for this snap is: volume-90dff48a-d49f-4974-9ac6-a337ad528144.75711fc9-5a29-4ad9-b987-d1a744719bb9 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:13:03 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[14149999-2221-4957-a413-ae3086f3565a]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:13:03 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e5cc34a3-b673-4344-81ed-09f760836a91 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144.75711fc9-5a29-4ad9-b987-d1a744719bb9 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:03 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144.75711fc9-5a29-4ad9-b987-d1a744719bb9 Sep 21 12:13:03 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:04 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.349s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:04 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:13:04 devstack cinder-volume[86366]: DEBUG oslo_service.periodic_task [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] Running periodic task VolumeManager._thread_info {{(pid=86366) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 21 12:13:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread count: 28 {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 21 12:13:04 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-44e7afb6-391d-4d4e-b868-60fcd09261b0 None None] thread info: [<_MainThread(MainThread, started 132841976594560)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86366) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 21 12:13:04 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e5cc34a3-b673-4344-81ed-09f760836a91 tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144.75711fc9-5a29-4ad9-b987-d1a744719bb9" returned: 0 in 0.528s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:04 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-e5cc34a3-b673-4344-81ed-09f760836a91 tempest-ProjectMemberTests-2128151930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90dff48a-d49f-4974-9ac6-a337ad528144(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:13:04 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4f3fe9-2717-4fc1-a2b2-09f5bd6d91ed]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:13:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e5cc34a3-b673-4344-81ed-09f760836a91 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:04 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144 Sep 21 12:13:04 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:04 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e5cc34a3-b673-4344-81ed-09f760836a91 tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144" returned: 0 in 0.401s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:04 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e5cc34a3-b673-4344-81ed-09f760836a91 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144.75711fc9-5a29-4ad9-b987-d1a744719bb9 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:04 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144.75711fc9-5a29-4ad9-b987-d1a744719bb9 Sep 21 12:13:04 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:05 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e5cc34a3-b673-4344-81ed-09f760836a91 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144.75711fc9-5a29-4ad9-b987-d1a744719bb9" returned: 0 in 0.407s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e5cc34a3-b673-4344-81ed-09f760836a91 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144.75711fc9-5a29-4ad9-b987-d1a744719bb9 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:05 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144.75711fc9-5a29-4ad9-b987-d1a744719bb9 Sep 21 12:13:05 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:05 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:05 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e5cc34a3-b673-4344-81ed-09f760836a91 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144.75711fc9-5a29-4ad9-b987-d1a744719bb9" returned: 0 in 0.266s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e5cc34a3-b673-4344-81ed-09f760836a91 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-75711fc9-5a29-4ad9-b987-d1a744719bb9" released by "_delete_snapshot" :: held 1.731s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:13:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e5cc34a3-b673-4344-81ed-09f760836a91 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-90dff48a-d49f-4974-9ac6-a337ad528144" released by "delete_snapshot" :: held 1.758s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:13:05 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-e5cc34a3-b673-4344-81ed-09f760836a91 tempest-ProjectMemberTests-2128151930 None] Created reservations ['9d9f5adb-d056-42cb-84a0-393fdad3a8be', '2bca13f3-9214-4428-a208-2189bb259059', '0f82a1a0-c954-4c39-b7ea-159a63ff993e', 'ee189bc8-3145-413a-9767-02080b6344ac'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:13:05 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-e5cc34a3-b673-4344-81ed-09f760836a91 tempest-ProjectMemberTests-2128151930 None] Delete snapshot completed successfully. Sep 21 12:13:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e5cc34a3-b673-4344-81ed-09f760836a91 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-75711fc9-5a29-4ad9-b987-d1a744719bb9-delete_snapshot" released by "delete_snapshot" :: held 1.895s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:13:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-205e7c60-8d8d-4cdf-b9c0-be5c8741591b tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-90dff48a-d49f-4974-9ac6-a337ad528144-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:13:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-205e7c60-8d8d-4cdf-b9c0-be5c8741591b tempest-ProjectMemberTests-2128151930 None] Lock "cinder-90dff48a-d49f-4974-9ac6-a337ad528144-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:13:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-205e7c60-8d8d-4cdf-b9c0-be5c8741591b tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-quobyte-90dff48a-d49f-4974-9ac6-a337ad528144" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:13:05 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-205e7c60-8d8d-4cdf-b9c0-be5c8741591b tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-90dff48a-d49f-4974-9ac6-a337ad528144" acquired by "delete_volume" :: waited 0.019s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:13:06 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ca9d69-12a4-47b2-a32a-f356cd46e53b]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:13:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-205e7c60-8d8d-4cdf-b9c0-be5c8741591b tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:06 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144 Sep 21 12:13:06 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:06 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-205e7c60-8d8d-4cdf-b9c0-be5c8741591b tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144" returned: 0 in 0.441s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-205e7c60-8d8d-4cdf-b9c0-be5c8741591b tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:06 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144 Sep 21 12:13:06 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:06 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-205e7c60-8d8d-4cdf-b9c0-be5c8741591b tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-90dff48a-d49f-4974-9ac6-a337ad528144" returned: 0 in 0.280s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:06 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-205e7c60-8d8d-4cdf-b9c0-be5c8741591b tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-90dff48a-d49f-4974-9ac6-a337ad528144" released by "delete_volume" :: held 0.794s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:13:06 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-205e7c60-8d8d-4cdf-b9c0-be5c8741591b tempest-ProjectMemberTests-2128151930 None] Created reservations ['20950e17-2fd1-4697-8b05-6e04fa129b7c', 'd4b065b9-60c6-47d2-af61-93f96a00d4eb', '18fc0a3b-495a-4457-8594-4cd21b76fe18', '3ab57827-7937-4484-92a4-a93c8819307d'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:13:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-205e7c60-8d8d-4cdf-b9c0-be5c8741591b tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:13:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-205e7c60-8d8d-4cdf-b9c0-be5c8741591b tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:13:06 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-205e7c60-8d8d-4cdf-b9c0-be5c8741591b tempest-ProjectMemberTests-2128151930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:13:06 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-205e7c60-8d8d-4cdf-b9c0-be5c8741591b tempest-ProjectMemberTests-2128151930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:13:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-205e7c60-8d8d-4cdf-b9c0-be5c8741591b tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:13:06 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-205e7c60-8d8d-4cdf-b9c0-be5c8741591b tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:06 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:13:06 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:07 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-205e7c60-8d8d-4cdf-b9c0-be5c8741591b tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.338s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:07 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-205e7c60-8d8d-4cdf-b9c0-be5c8741591b tempest-ProjectMemberTests-2128151930 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:13:07 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-205e7c60-8d8d-4cdf-b9c0-be5c8741591b tempest-ProjectMemberTests-2128151930 None] Deleted volume successfully. Sep 21 12:13:07 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-205e7c60-8d8d-4cdf-b9c0-be5c8741591b tempest-ProjectMemberTests-2128151930 None] Lock "cinder-90dff48a-d49f-4974-9ac6-a337ad528144-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:13:07 devstack cinder-volume[86366]: DEBUG cinder.volume.flows.manager.create_volume [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86366) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 21 12:13:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Flow 'volume_create_manager' (da8fc76f-f691-408e-b01b-c4f73ae778cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:13:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d425b3b9-5a07-49b1-ba9e-ac32d0141441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:13:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d425b3b9-5a07-49b1-ba9e-ac32d0141441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1093067904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42645c74-9a34-4fd6-8e27-0916e23897db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3ab3953afc4ba588a5a6758fef10a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:13:08Z,use_quota=True,user_id='8da888e194c942a6896757d64cd62196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:13:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48cabc70-b154-43a3-bcc0-9f8e014dac7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:13:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48cabc70-b154-43a3-bcc0-9f8e014dac7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:13:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a498383-4bb5-4798-a40f-1c8f3cc76b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:13:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a498383-4bb5-4798-a40f-1c8f3cc76b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42645c74-9a34-4fd6-8e27-0916e23897db', 'volume_name': 'volume-42645c74-9a34-4fd6-8e27-0916e23897db', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:13:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6738f9ee-247f-48d9-9e0a-7bcd6362df92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:13:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6738f9ee-247f-48d9-9e0a-7bcd6362df92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:13:07 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af65ba4a-0726-4a6a-b45b-1f07acc57f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:13:07 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Volume 42645c74-9a34-4fd6-8e27-0916e23897db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42645c74-9a34-4fd6-8e27-0916e23897db', 'volume_size': 1} Sep 21 12:13:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:13:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:13:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-21T10:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1093067904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42645c74-9a34-4fd6-8e27-0916e23897db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb3ab3953afc4ba588a5a6758fef10a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-21T10:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-21T10:13:08Z,use_quota=True,user_id='8da888e194c942a6896757d64cd62196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ab8862b-1be8-474f-bfcc-e9259eeacaec),volume_type_id=3ab8862b-1be8-474f-bfcc-e9259eeacaec)}" {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 21 12:13:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Creating volume 42645c74-9a34-4fd6-8e27-0916e23897db {{(pid=86366) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 21 12:13:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:13:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:13:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:13:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:13:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:13:07 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Selected osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d as target Quobyte volume. {{(pid=86366) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 21 12:13:07 devstack cinder-volume[86366]: INFO cinder.volume.drivers.remotefs [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] casted to osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d Sep 21 12:13:07 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db 1073741824 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:07 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db 1073741824 Sep 21 12:13:07 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:08 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db 1073741824" returned: 0 in 0.527s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:08 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db Sep 21 12:13:08 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:08 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db" returned: 0 in 0.270s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:08 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'} {{(pid=86366) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 21 12:13:08 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:13:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af65ba4a-0726-4a6a-b45b-1f07acc57f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42645c74-9a34-4fd6-8e27-0916e23897db', 'volume_size': 1}' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:13:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947fccff-8cb3-42f3-bbde-43bcaed2152a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 21 12:13:08 devstack cinder-volume[86366]: INFO cinder.volume.flows.manager.create_volume [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Volume volume-42645c74-9a34-4fd6-8e27-0916e23897db (42645c74-9a34-4fd6-8e27-0916e23897db): created successfully Sep 21 12:13:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947fccff-8cb3-42f3-bbde-43bcaed2152a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86366) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 21 12:13:08 devstack cinder-volume[86366]: DEBUG cinder.volume.manager [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Flow 'volume_create_manager' (da8fc76f-f691-408e-b01b-c4f73ae778cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86366) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 21 12:13:08 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-23b69532-d1a0-4c4a-9743-4bb8f5bbcc62 tempest-ProjectMemberTests-2128151930 None] Created volume successfully. Sep 21 12:13:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-92e9994a-1364-49c7-b9db-1e6116295652 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:13:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-92e9994a-1364-49c7-b9db-1e6116295652 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:13:09 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-92e9994a-1364-49c7-b9db-1e6116295652 tempest-ProjectMemberTests-2128151930 None] Creating offline snapshot 31b5c157-4fda-42e0-a31b-78f652b15978 of volume 42645c74-9a34-4fd6-8e27-0916e23897db {{(pid=86366) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 21 12:13:09 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f549d41-5f34-4f51-8f4d-a08322650d63]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:13:09 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-92e9994a-1364-49c7-b9db-1e6116295652 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:10 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db Sep 21 12:13:10 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:10 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-92e9994a-1364-49c7-b9db-1e6116295652 tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db" returned: 0 in 0.361s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-92e9994a-1364-49c7-b9db-1e6116295652 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db.31b5c157-4fda-42e0-a31b-78f652b15978 1G {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:10 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db.31b5c157-4fda-42e0-a31b-78f652b15978 1G Sep 21 12:13:10 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:10 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-92e9994a-1364-49c7-b9db-1e6116295652 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db.31b5c157-4fda-42e0-a31b-78f652b15978 1G" returned: 0 in 0.394s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-92e9994a-1364-49c7-b9db-1e6116295652 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42645c74-9a34-4fd6-8e27-0916e23897db -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db.31b5c157-4fda-42e0-a31b-78f652b15978 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:10 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42645c74-9a34-4fd6-8e27-0916e23897db -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db.31b5c157-4fda-42e0-a31b-78f652b15978 Sep 21 12:13:10 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:10 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-92e9994a-1364-49c7-b9db-1e6116295652 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42645c74-9a34-4fd6-8e27-0916e23897db -F qcow2 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db.31b5c157-4fda-42e0-a31b-78f652b15978" returned: 0 in 0.292s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:10 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-92e9994a-1364-49c7-b9db-1e6116295652 tempest-ProjectMemberTests-2128151930 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db.31b5c157-4fda-42e0-a31b-78f652b15978 is being set with open permissions: ugo+rw Sep 21 12:13:10 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-92e9994a-1364-49c7-b9db-1e6116295652 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db.31b5c157-4fda-42e0-a31b-78f652b15978 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:10 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db.31b5c157-4fda-42e0-a31b-78f652b15978 Sep 21 12:13:10 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:11 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-92e9994a-1364-49c7-b9db-1e6116295652 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db.31b5c157-4fda-42e0-a31b-78f652b15978" returned: 0 in 0.236s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-92e9994a-1364-49c7-b9db-1e6116295652 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:11 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db.info Sep 21 12:13:11 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:11 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-92e9994a-1364-49c7-b9db-1e6116295652 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db.info" returned: 0 in 0.250s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:11 devstack cinder-volume[86366]: WARNING cinder.volume.drivers.remotefs [None req-92e9994a-1364-49c7-b9db-1e6116295652 tempest-ProjectMemberTests-2128151930 None] /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db.info is being set with open permissions: ugo+rw Sep 21 12:13:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-92e9994a-1364-49c7-b9db-1e6116295652 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db.info {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:11 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db.info Sep 21 12:13:11 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:11 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-92e9994a-1364-49c7-b9db-1e6116295652 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db.info" returned: 0 in 0.233s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:11 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-92e9994a-1364-49c7-b9db-1e6116295652 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.844s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:13:11 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=113,cinder:INSERT=36,cinder:DELETE=8,cinder:UPDATE=137 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:13:11 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-92e9994a-1364-49c7-b9db-1e6116295652 tempest-ProjectMemberTests-2128151930 None] Create snapshot completed successfully Sep 21 12:13:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2dfa7a00-f4fc-48a8-bb42-3ecdff77fcc9 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-31b5c157-4fda-42e0-a31b-78f652b15978-delete_snapshot" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:13:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2dfa7a00-f4fc-48a8-bb42-3ecdff77fcc9 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-31b5c157-4fda-42e0-a31b-78f652b15978-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:13:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2dfa7a00-f4fc-48a8-bb42-3ecdff77fcc9 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-quobyte-42645c74-9a34-4fd6-8e27-0916e23897db" by "delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:13:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2dfa7a00-f4fc-48a8-bb42-3ecdff77fcc9 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-42645c74-9a34-4fd6-8e27-0916e23897db" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:13:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2dfa7a00-f4fc-48a8-bb42-3ecdff77fcc9 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-quobyte-31b5c157-4fda-42e0-a31b-78f652b15978" by "_delete_snapshot" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:13:12 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2dfa7a00-f4fc-48a8-bb42-3ecdff77fcc9 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-31b5c157-4fda-42e0-a31b-78f652b15978" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:13:12 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-2dfa7a00-f4fc-48a8-bb42-3ecdff77fcc9 tempest-ProjectMemberTests-2128151930 None] Deleting offline snapshot 31b5c157-4fda-42e0-a31b-78f652b15978 of volume 42645c74-9a34-4fd6-8e27-0916e23897db {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 21 12:13:12 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-2dfa7a00-f4fc-48a8-bb42-3ecdff77fcc9 tempest-ProjectMemberTests-2128151930 None] snapshot_file for this snap is: volume-42645c74-9a34-4fd6-8e27-0916e23897db.31b5c157-4fda-42e0-a31b-78f652b15978 {{(pid=86366) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 21 12:13:12 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f9a614-83a3-4ac5-b09f-25c483aa08f0]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:13:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2dfa7a00-f4fc-48a8-bb42-3ecdff77fcc9 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db.31b5c157-4fda-42e0-a31b-78f652b15978 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:12 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db.31b5c157-4fda-42e0-a31b-78f652b15978 Sep 21 12:13:12 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:12 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2dfa7a00-f4fc-48a8-bb42-3ecdff77fcc9 tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db.31b5c157-4fda-42e0-a31b-78f652b15978" returned: 0 in 0.361s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:12 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.remotefs [None req-2dfa7a00-f4fc-48a8-bb42-3ecdff77fcc9 tempest-ProjectMemberTests-2128151930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42645c74-9a34-4fd6-8e27-0916e23897db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86366) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 21 12:13:12 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d182e1-584a-44db-8fbe-64f340134636]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:13:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2dfa7a00-f4fc-48a8-bb42-3ecdff77fcc9 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:12 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db Sep 21 12:13:12 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:12 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2dfa7a00-f4fc-48a8-bb42-3ecdff77fcc9 tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db" returned: 0 in 0.359s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:12 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2dfa7a00-f4fc-48a8-bb42-3ecdff77fcc9 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db.31b5c157-4fda-42e0-a31b-78f652b15978 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:12 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db.31b5c157-4fda-42e0-a31b-78f652b15978 Sep 21 12:13:12 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:13 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2dfa7a00-f4fc-48a8-bb42-3ecdff77fcc9 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db.31b5c157-4fda-42e0-a31b-78f652b15978" returned: 0 in 0.322s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2dfa7a00-f4fc-48a8-bb42-3ecdff77fcc9 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db.31b5c157-4fda-42e0-a31b-78f652b15978 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:13 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db.31b5c157-4fda-42e0-a31b-78f652b15978 Sep 21 12:13:13 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:13 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:13 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-2dfa7a00-f4fc-48a8-bb42-3ecdff77fcc9 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db.31b5c157-4fda-42e0-a31b-78f652b15978" returned: 0 in 0.232s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:13 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2dfa7a00-f4fc-48a8-bb42-3ecdff77fcc9 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-31b5c157-4fda-42e0-a31b-78f652b15978" released by "_delete_snapshot" :: held 1.382s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:13:13 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2dfa7a00-f4fc-48a8-bb42-3ecdff77fcc9 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-42645c74-9a34-4fd6-8e27-0916e23897db" released by "delete_snapshot" :: held 1.408s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:13:13 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=108,cinder:UPDATE=138,cinder:INSERT=40,cinder:DELETE=16 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:13:13 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-2dfa7a00-f4fc-48a8-bb42-3ecdff77fcc9 tempest-ProjectMemberTests-2128151930 None] Created reservations ['578b8782-1c37-4bd6-9e58-fb1dec6b5e24', '9fe8f14f-cb44-4452-ae87-981bd4fa870e', 'c4349370-217e-4c0b-8d2c-4712e9245ca7', '04aac47f-4842-47bf-a940-0faed1cd8068'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:13:13 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-2dfa7a00-f4fc-48a8-bb42-3ecdff77fcc9 tempest-ProjectMemberTests-2128151930 None] Delete snapshot completed successfully. Sep 21 12:13:13 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-2dfa7a00-f4fc-48a8-bb42-3ecdff77fcc9 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-31b5c157-4fda-42e0-a31b-78f652b15978-delete_snapshot" released by "delete_snapshot" :: held 1.539s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:13:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e78d9a61-ab3f-449d-88f8-1876fec53894 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-42645c74-9a34-4fd6-8e27-0916e23897db-delete_volume" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:13:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e78d9a61-ab3f-449d-88f8-1876fec53894 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-42645c74-9a34-4fd6-8e27-0916e23897db-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:13:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e78d9a61-ab3f-449d-88f8-1876fec53894 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "cinder-quobyte-42645c74-9a34-4fd6-8e27-0916e23897db" by "delete_volume" {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 21 12:13:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e78d9a61-ab3f-449d-88f8-1876fec53894 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-42645c74-9a34-4fd6-8e27-0916e23897db" acquired by "delete_volume" :: waited 0.017s {{(pid=86366) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 21 12:13:14 devstack cinder-volume[86366]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecb64fa-c326-4dcb-9240-aa010404d79f]: (4, 'qcow2') {{(pid=87408) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 21 12:13:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e78d9a61-ab3f-449d-88f8-1876fec53894 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:14 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db Sep 21 12:13:14 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:14 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e78d9a61-ab3f-449d-88f8-1876fec53894 tempest-ProjectMemberTests-2128151930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db" returned: 0 in 0.346s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e78d9a61-ab3f-449d-88f8-1876fec53894 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:14 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db Sep 21 12:13:14 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:14 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:14 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e78d9a61-ab3f-449d-88f8-1876fec53894 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939/volume-42645c74-9a34-4fd6-8e27-0916e23897db" returned: 0 in 0.261s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:14 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e78d9a61-ab3f-449d-88f8-1876fec53894 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-quobyte-42645c74-9a34-4fd6-8e27-0916e23897db" released by "delete_volume" :: held 0.663s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:13:14 devstack cinder-volume[86366]: DEBUG cinder.quota [None req-e78d9a61-ab3f-449d-88f8-1876fec53894 tempest-ProjectMemberTests-2128151930 None] Created reservations ['89d39b86-f3d2-4566-9f32-97511edaf9fc', 'fd76a90e-442a-44ff-8521-46e63150553d', '028f3c31-d7ab-4d54-939b-3735f077e196', '4289e798-f3e5-42de-b5a6-a8a6d374d620'] {{(pid=86366) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 21 12:13:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e78d9a61-ab3f-449d-88f8-1876fec53894 tempest-ProjectMemberTests-2128151930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 21 12:13:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e78d9a61-ab3f-449d-88f8-1876fec53894 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 21 12:13:15 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e78d9a61-ab3f-449d-88f8-1876fec53894 tempest-ProjectMemberTests-2128151930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d': None} {{(pid=86366) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 21 12:13:15 devstack cinder-volume[86366]: DEBUG cinder.volume.drivers.quobyte [None req-e78d9a61-ab3f-449d-88f8-1876fec53894 tempest-ProjectMemberTests-2128151930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-73b1aed4-ee45-4a20-b77d-98b72b98771d'] {{(pid=86366) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 21 12:13:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.lockutils [None req-e78d9a61-ab3f-449d-88f8-1876fec53894 tempest-ProjectMemberTests-2128151930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86366) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 21 12:13:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e78d9a61-ab3f-449d-88f8-1876fec53894 tempest-ProjectMemberTests-2128151930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 21 12:13:15 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939 Sep 21 12:13:15 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 21 12:13:15 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Sep 21 12:13:15 devstack cinder-volume[86366]: DEBUG oslo_concurrency.processutils [None req-e78d9a61-ab3f-449d-88f8-1876fec53894 tempest-ProjectMemberTests-2128151930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ba4cd4c2a5479d9d87f0ad344562c939" returned: 0 in 0.284s {{(pid=86366) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 21 12:13:15 devstack cinder-volume[86366]: DEBUG cinder.manager [None req-e78d9a61-ab3f-449d-88f8-1876fec53894 tempest-ProjectMemberTests-2128151930 None] Notifying Schedulers of capabilities ... {{(pid=86366) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 21 12:13:15 devstack cinder-volume[86366]: INFO cinder.volume.manager [None req-e78d9a61-ab3f-449d-88f8-1876fec53894 tempest-ProjectMemberTests-2128151930 None] Deleted volume successfully. Sep 21 12:13:15 devstack cinder-volume[86366]: DEBUG cinder.coordination [None req-e78d9a61-ab3f-449d-88f8-1876fec53894 tempest-ProjectMemberTests-2128151930 None] Lock "cinder-42645c74-9a34-4fd6-8e27-0916e23897db-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=86366) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 21 12:13:25 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:SELECT=13,cinder:INSERT=4,cinder:UPDATE=12 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 21 12:13:25 devstack cinder-volume[86366]: DEBUG dbcounter [-] [86366] Writing DB stats cinder:INSERT=4,cinder:UPDATE=15,cinder:SELECT=5,cinder:DELETE=1 {{(pid=86366) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}